-- Logs begin at Fri 2022-08-12 11:06:06 UTC, end at Fri 2022-08-12 12:11:24 UTC. -- Aug 12 11:41:18.478409 dv-cinder-852828-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 12 11:41:18.485511 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 12 11:41:18.487538 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 12 11:41:18 2022] *** Aug 12 11:41:18.487538 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 12 11:41:18.487538 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 12 11:41:18.487538 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: nodename: dv-cinder-852828-2-iscsi Aug 12 11:41:18.487538 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: machine: x86_64 Aug 12 11:41:18.487538 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: clock source: unix Aug 12 11:41:18.487538 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: pcre jit disabled Aug 12 11:41:18.487538 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: detected number of CPU cores: 4 Aug 12 11:41:18.488116 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: current working directory: / Aug 12 11:41:18.488116 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: detected binary path: /usr/bin/uwsgi-core Aug 12 11:41:18.488116 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: your processes number limit is 47680 Aug 12 11:41:18.488116 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: your memory page size is 4096 bytes Aug 12 11:41:18.488116 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: detected max file descriptor number: 2048 Aug 12 11:41:18.488116 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: lock engine: pthread robust mutexes Aug 12 11:41:18.488116 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: thunder lock: enabled Aug 12 11:41:18.488116 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 12 11:41:18.488116 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 12 11:41:18.527971 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: Python main interpreter initialized at 0x55bb16fb09c0 Aug 12 11:41:18.527971 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: python threads support enabled Aug 12 11:41:18.527971 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: your server socket listen backlog is limited to 100 connections Aug 12 11:41:18.527971 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: your mercy for graceful operations on workers is 90 seconds Aug 12 11:41:18.528345 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: mapped 403077 bytes (393 KB) for 2 cores Aug 12 11:41:18.528424 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: *** Operational MODE: preforking *** Aug 12 11:41:18.528659 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: *** uWSGI is running in multiple interpreter mode *** Aug 12 11:41:18.528659 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: spawned uWSGI master process (pid: 117197) Aug 12 11:41:18.528846 dv-cinder-852828-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 12 11:41:18.530250 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: spawned uWSGI worker 1 (pid: 117198, cores: 1) Aug 12 11:41:18.530250 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: spawned uWSGI worker 2 (pid: 117199, cores: 1) Aug 12 11:41:18.530250 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 12 11:41:19.177594 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 12 11:41:19.187401 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 12 11:41:20.261156 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 11:41:20.261156 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: from cryptography.utils import int_from_bytes Aug 12 11:41:20.261720 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 11:41:20.261720 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: from cryptography.utils import int_from_bytes Aug 12 11:41:20.267385 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 11:41:20.267385 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: from cryptography.utils import int_from_bytes Aug 12 11:41:20.267828 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 11:41:20.267828 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: from cryptography.utils import int_from_bytes Aug 12 11:41:22.756788 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 11:41:22.757344 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 11:41:22.757567 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 11:41:22.757924 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 11:41:22.758174 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 11:41:22.758551 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.758839 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 11:41:22.759200 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.759299 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 11:41:22.759369 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.759500 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.759594 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 11:41:22.759806 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.759964 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 11:41:22.760103 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.760228 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 11:41:22.760415 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.760616 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.760726 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.760944 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.761031 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.761267 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.761359 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.761574 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.761658 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.761887 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852828-2-iscsi {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.761973 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.762199 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.762291 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.762497 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.762591 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.762824 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.762912 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.763133 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.763219 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.763415 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.763515 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.763731 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.763824 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.764024 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.764115 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852828-2-iscsi {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.764367 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.764505 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.764677 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.764946 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.765041 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.765245 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.765345 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.765547 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.765670 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.765873 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.765991 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.766176 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.766305 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.766478 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.766695 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.766849 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.767009 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.767168 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.767317 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.767444 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.767712 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.768012 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.768220 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852828-2-iscsi {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.768372 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.768586 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.768743 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.768917 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.769134 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.769342 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.769494 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.769714 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.769864 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.770081 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.770237 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.770456 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.770622 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.770790 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.770790 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.771089 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852828-2-iscsi {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.771214 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.771376 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.771504 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.771626 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.771748 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.771877 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.772007 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.772177 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.772303 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.772424 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.772554 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.773169 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.773301 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.773456 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.773582 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.773704 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.773826 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.773956 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.774087 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.774218 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.774342 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.774463 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.774584 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.774765 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.774903 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.775078 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.775212 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.775390 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.775518 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.775700 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.775841 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.775965 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.776145 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.776281 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.776406 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.776611 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.776745 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.776869 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.776992 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.777113 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.777235 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.777372 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.777503 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.777626 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.777756 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.777886 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.778072 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.778208 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.778394 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.778524 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.778667 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.778792 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.778932 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.779057 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.779229 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.779402 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.779551 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.779692 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.779859 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.779987 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.780166 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.780308 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.780473 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.780610 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.780785 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.780919 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.781090 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.781218 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.781388 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.781521 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.781692 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.781823 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.781997 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.782125 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.782298 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.782432 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.782648 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.782792 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.782927 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.783051 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.783221 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.783365 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.783517 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.783645 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.783813 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.783961 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.784123 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.784257 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.784446 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.784573 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.784741 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.784874 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.785010 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.785135 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.785257 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.785379 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.785541 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.785668 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.785848 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.785976 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.786142 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.786276 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.786437 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.786574 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.786822 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.786952 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.787113 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.787240 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.787413 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.787552 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.787707 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.787849 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.788002 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.788129 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.788397 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.789025 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.789150 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.789273 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.789433 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.789596 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.789720 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.789855 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.790010 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.790137 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.790306 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.790434 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.790633 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.790781 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.790952 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.791079 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.791247 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.791384 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.791542 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.791694 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.791826 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.791962 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.792122 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.792259 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.792425 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.792566 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.792720 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.792845 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.793019 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.793157 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.793324 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.793461 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.793620 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.793745 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.793915 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.794042 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.794223 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.794351 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.794520 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.794709 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.794846 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.794970 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.795136 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.795280 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.795428 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.795554 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.795724 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.795859 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.796032 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.796159 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.796328 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.796462 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.796624 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.796750 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.796920 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.797048 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.797217 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.797345 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.797519 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.797646 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.797816 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.797944 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.798109 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.798236 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.798405 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.798531 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.798717 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.798846 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.799027 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.799154 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.799339 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.799476 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.799635 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.799773 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.799927 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.800054 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.800224 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.800365 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.800526 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.800660 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.800839 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.800973 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.801141 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.801277 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.801447 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.801575 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.801748 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.801876 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.802068 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.802209 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.802386 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.802517 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.802717 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.802844 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.803045 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.803171 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.803315 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.803441 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.803627 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:41:22.803754 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.803953 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.804079 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.804259 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.804394 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.804565 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.804692 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.804876 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.805011 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.805184 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.805302 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.805505 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.805641 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.805815 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.805942 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.806123 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.806258 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.806433 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.806859 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.807030 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.807178 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.807345 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.807480 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.807665 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.807803 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.807978 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.808105 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.808282 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.808409 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.808600 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.808734 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.808929 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.809057 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.809232 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.809357 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.809547 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.809717 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.809844 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.809967 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.810151 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.810278 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.810455 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.810592 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.810772 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.810897 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.811084 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.811224 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.811406 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.811527 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.811710 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.811837 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.812019 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.812148 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.812323 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.812451 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.812628 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.812749 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.812931 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.813059 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.813235 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.813370 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.813537 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.813668 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.813863 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.813996 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.814195 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.814327 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.814457 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.814580 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.814804 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.814932 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.815114 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.815244 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.815417 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.815552 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.815720 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.815860 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.816021 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.816150 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.816317 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.816444 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.816613 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.816754 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.816909 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.817036 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.817209 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.817345 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.817510 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.817647 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.817822 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.817956 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.818139 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.818267 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.818437 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.818580 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.818785 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.818913 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.819084 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.819210 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.819387 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.819524 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.819739 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.819872 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.820017 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.820151 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.820313 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.820443 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.820616 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.820744 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.820920 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.821053 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.821216 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.821345 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.821532 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.821659 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.821837 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.821972 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.822133 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.822269 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.822445 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.822580 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.822767 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.822906 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.823066 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.823193 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.823367 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.823494 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.823670 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.823805 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.823971 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.824098 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.824274 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.824399 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.824575 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.824713 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.824890 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.825017 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.825192 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.825318 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.825492 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.825697 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.825824 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.825953 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.826098 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.826226 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.826406 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.826533 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.826737 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.826875 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.827050 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.827183 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.827358 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.827485 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.827651 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.827777 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.827951 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.828086 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.828247 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.828382 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.828541 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.828668 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.828834 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.828961 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.829132 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.829261 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.829424 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.829550 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.829718 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.829887 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.830023 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.830147 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.830291 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.830418 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.830583 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.830734 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.830914 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.831042 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.831214 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.831341 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.831507 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.831647 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.831802 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.831931 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.832094 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.832220 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.832425 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.832561 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.832722 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.832850 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.833049 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.833175 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.833352 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.833487 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.833655 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.833782 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.833967 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.834092 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.834270 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.834405 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.834570 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.834717 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.834897 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.835033 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.835709 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.835836 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.836011 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.836138 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.836315 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.836443 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.836625 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.836754 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.836925 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.837053 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.837233 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.837368 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.837535 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.837661 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.837852 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.837977 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.838151 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.838287 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.838460 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.838594 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.838779 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.838908 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.839085 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.839226 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.839408 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.839533 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.839728 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.839853 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.840016 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.840147 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.840332 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.840467 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.840632 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.840765 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.840937 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.841073 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.841236 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.841364 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.841537 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.841671 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.841836 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.841964 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.842134 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.842260 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.842440 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.842575 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.842762 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.842888 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.843057 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.843175 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.843357 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.843484 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.843669 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.843805 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.843967 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.844094 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.844273 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.844399 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.844566 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.844693 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.844869 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.845005 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.845185 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.845320 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.845499 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.845624 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.845797 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.845921 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.846098 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.846235 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.846403 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.846535 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.846722 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.846852 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.847024 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.847162 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.847325 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.847452 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.847621 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.847748 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.847920 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.848052 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.848219 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.848347 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.848522 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.848650 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.848823 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.848951 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.849122 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.849248 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.849414 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.849548 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.849719 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.849848 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.850010 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.850144 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.850296 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.850423 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.850590 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.850818 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.851430 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.851556 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.851753 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.851881 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.852056 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.852192 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.852369 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.852496 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.852680 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.852814 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.852976 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.853104 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.853271 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.853405 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.853578 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.853712 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.853877 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.854004 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.854174 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.854301 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.854469 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.854695 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.854831 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.854969 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.855093 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.855214 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.855398 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.855532 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.855695 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.855822 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.856002 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.856538 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.856538 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.856761 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.856761 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.856959 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.857063 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.857167 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.857279 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.857387 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.857498 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.857602 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.857776 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.857887 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.858079 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.858205 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.858381 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.858498 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.858700 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.858829 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.859004 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.859126 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.859305 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.859425 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.859606 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.859718 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.859923 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.860080 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.860227 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.860339 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.860530 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.860653 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.860832 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.860945 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.861130 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.861250 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.861431 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.861553 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.861739 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.861871 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.862047 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.862303 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.862439 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.862648 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.862779 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.862967 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.863093 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.863282 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.863407 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.863617 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.863750 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.863903 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.864036 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.864205 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.864339 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.864515 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.864650 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.864834 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.864961 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.865147 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.865396 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.865533 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.865730 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.865856 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.866024 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.866156 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.866328 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.866489 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.866660 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.866787 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.866963 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.867090 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.867260 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.867400 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.867564 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.867692 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.867865 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.868011 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.868165 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.868302 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.868462 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.868592 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.868757 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.868884 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.869066 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.869185 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.869367 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.869465 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.869672 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.869766 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.869968 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.870061 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.870281 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.870375 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.870584 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.870713 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.870901 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.871004 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.871195 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.871287 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.871498 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.871595 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.871812 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.871916 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.872110 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.872203 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.872415 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.872508 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.872725 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.872827 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.873027 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.873119 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.873347 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.873452 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.874101 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.874191 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.874191 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.874326 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.874326 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.874454 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.874529 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.874630 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.874813 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.874921 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.875134 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.875245 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.875416 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.875513 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.875707 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.875795 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.876008 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.876125 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.876309 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.876405 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.876606 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.876693 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.876907 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.877005 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.877203 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.877290 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.877503 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.877590 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.877804 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.877895 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.878109 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.878197 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.878406 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.878493 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.878718 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.878811 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.879012 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.879112 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.879313 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.879400 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.879611 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.879700 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.879904 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.879990 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.880203 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.880297 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.880494 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.880589 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.880798 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.880885 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.881093 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.881189 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.881386 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.881481 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.881678 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.881781 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.881980 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.882107 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.882298 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.882386 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.882591 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.882693 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.882915 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.883019 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.883214 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.883301 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.883508 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.883608 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.883804 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.883909 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.884102 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.884189 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.884396 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.884482 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.884689 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.884777 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.884988 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.885075 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.885293 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.885379 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.885596 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.885691 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.885888 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.885980 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.886188 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.886274 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.886483 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.886579 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.886800 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.886890 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.887095 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.887182 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.887395 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.887491 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.887690 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.887778 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.887990 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.888090 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.888285 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.888380 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.888578 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.888672 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.888871 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.888971 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.889183 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.889270 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.889483 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.889569 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.889774 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.889868 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.890070 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.890157 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.890363 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.890451 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.890684 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.890787 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.890990 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.891077 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.891292 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.891379 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.891602 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.891690 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.891905 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.892007 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.892216 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.892314 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.892516 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.892605 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.892816 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.892908 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.893116 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.893202 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.893412 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.893500 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.893719 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.893810 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.894022 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.894113 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.894327 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.894414 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.894635 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.894833 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.894920 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.895153 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.895241 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.895473 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.895566 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.895786 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.895873 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.896098 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.896193 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.896413 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.896500 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.896716 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.896803 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.897014 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.897101 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.897316 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.897405 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.897620 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.898205 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.898431 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.898526 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.898753 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.898842 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.899058 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.899146 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.899361 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.899449 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.899664 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.899751 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.899967 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.900067 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.900270 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.900364 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.900573 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.900660 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.900873 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.900968 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.901176 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.901275 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.901480 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.901579 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.901779 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.901874 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.902094 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.902236 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.902394 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.902482 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.902718 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.902828 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.903021 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.903107 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.903318 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.903404 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.903619 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.903707 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.903915 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.904047 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.904224 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.904317 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.904538 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.904625 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.904850 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.904944 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.905158 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.905244 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.905480 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.905573 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.905781 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.905868 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.906084 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.906182 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.906387 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.906519 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.906708 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.906798 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.907015 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.907117 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.907320 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.907415 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.907691 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.907783 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.907993 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.908088 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.908295 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.908393 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.908588 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.908683 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.908889 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.908984 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.909202 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.909289 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.909497 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.909585 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.909792 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.909888 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.910086 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.910180 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.910399 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.910484 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.910722 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.910813 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.911037 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.911123 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.911411 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.911496 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.911716 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.911805 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.912016 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.912101 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.912361 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.912460 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.912640 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.912762 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.912944 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.913031 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.913261 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.913943 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.914100 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.914188 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.914423 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.914513 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.914751 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.914859 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.915058 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.915151 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.915361 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.915479 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.915675 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.915794 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.915990 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.916101 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.916291 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.916521 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.916628 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.916837 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.916926 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.917151 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.917247 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.917475 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.917562 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.917776 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.917861 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.918088 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.918183 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.918396 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.918490 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.918735 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.918828 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.919047 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.919136 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.919372 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.919466 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.919727 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.919824 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.920024 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.920110 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.920320 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.920406 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.920623 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.920723 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.920920 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.921007 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.921213 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.921299 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.921527 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.921622 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.921824 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.921910 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.922125 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.922307 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.922453 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.922654 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.922768 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.922972 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.923073 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.923292 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.923394 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.923600 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.923686 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.923893 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.923981 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.924195 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.924294 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.924495 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.924580 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.924797 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.924882 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.925103 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.925200 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.925398 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.925483 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.925709 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.925862 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.925998 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.926093 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.926291 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.926379 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.926584 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.926739 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.926895 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.926985 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.927197 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.927291 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.927506 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.927592 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.927808 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.927903 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.928128 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.928215 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.928436 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.928529 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.928734 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.928821 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.929572 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.929669 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.929874 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.929968 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.930192 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.930278 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.930498 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.930583 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.930826 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.930931 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.931120 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.931215 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.931415 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.931780 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.932015 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.932123 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.932284 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.932372 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.932581 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.932683 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.932881 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.932995 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.933179 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.933274 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.933474 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.933561 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.933770 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.933865 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.934067 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.934155 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.934381 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.934468 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.934698 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.934792 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.935013 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.935102 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.935314 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.935400 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.935609 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.935705 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.935904 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.935991 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.936197 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.936284 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.936530 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.936618 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.936824 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.936917 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.937129 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.937227 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.937429 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.937513 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.937729 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.937821 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.938032 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.938128 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.938343 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.938428 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.938668 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.938768 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.938977 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.939078 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.939283 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.939369 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.939586 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.939678 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.939889 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.939983 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.940190 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.940275 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.940492 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.940578 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.940796 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.940884 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.941101 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.941188 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.941422 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.941612 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.941745 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.941931 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.942084 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.942236 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.942381 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.942541 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.942787 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.942922 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.943105 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.943226 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.943405 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.943520 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.944447 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.945178 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.945273 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.945364 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.945445 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.945533 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.945533 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.945679 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.945757 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.945835 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.945913 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.946000 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.946088 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.946267 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.946355 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.946593 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.946719 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.946941 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.947039 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.947234 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.947322 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.947541 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.947641 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.947852 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.947946 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.948165 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.948254 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.948473 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.948568 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.948779 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.948868 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.949088 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.949181 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.949392 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.949495 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.949696 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.949783 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.949996 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.950084 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.950301 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.950389 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.950669 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.950775 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.950926 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.951014 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.951229 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.951317 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.951535 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.951622 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.951839 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.951934 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.952154 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.952243 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.952479 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.952568 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.952790 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.952891 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.953163 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.953274 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.953397 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.953492 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.953703 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.953800 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.954010 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.954213 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.954324 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.954520 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.954688 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.954856 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.954990 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.955173 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.955303 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.955489 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.955616 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.955797 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.955929 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.956105 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.956244 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.956420 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.956567 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.956716 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.956899 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.957010 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.957219 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.957314 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.957532 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.957618 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.957845 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.957933 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.958159 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.958255 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.958474 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.958707 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.958799 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.959027 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.959114 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.959368 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.959489 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.959692 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.959900 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.960024 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.960266 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.960366 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.960581 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.960667 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.960903 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.961000 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.961225 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.961313 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.961535 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.961622 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.961837 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.961924 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.962156 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.962245 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.962459 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.962546 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.962780 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.962925 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.963091 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.963187 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.963394 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.963484 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.963690 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.963777 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.963986 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.964076 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.964289 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.964530 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.964617 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.964875 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.964963 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.965178 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.965265 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.965473 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.965561 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.965789 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.965878 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.966086 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.966174 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.966383 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.966482 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.966700 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.966792 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.967006 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.967093 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.967304 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.967391 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.967603 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.967691 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.967900 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.967986 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.968202 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.968298 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.968503 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.968589 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.968798 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.968883 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.969099 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.969194 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.969394 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.969526 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.969695 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.969791 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.969991 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.970087 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.970291 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.970379 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.970588 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.970698 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.970917 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.971052 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.971214 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.971301 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.971523 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.971609 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.971828 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.971916 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.972136 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.972230 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.972442 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.972529 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.972745 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.972833 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.973045 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.973132 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.973346 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.973432 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.973655 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.973743 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.973959 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.974184 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.974272 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.974508 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.974625 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.974846 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.974945 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.975170 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.975259 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.975489 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.975578 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.975806 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.975903 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.976108 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.976195 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.976406 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.976494 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.976721 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.976807 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.977024 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.977111 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.977326 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.977415 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.977628 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.977716 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.977929 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.978016 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.978235 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.978323 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.978534 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.978822 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.978912 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.979147 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.979242 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.979450 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.979577 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.979750 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.979838 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.980051 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.980140 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.980351 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.980437 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.980650 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.980737 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.980950 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.981039 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.981253 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.981340 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.981569 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.981664 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.981880 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.981967 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.982184 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.982279 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.982490 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.982590 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.982821 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.982920 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.983121 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.983208 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.983421 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.983567 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.983720 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.983808 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.984017 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.984105 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.984322 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.984417 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.984637 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.984733 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.984939 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.985028 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.985235 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.985331 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.985550 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.985636 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.985865 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.985952 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.986205 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.986301 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.986523 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.986667 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.986849 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.986936 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.987164 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.987252 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.987477 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.987566 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.987778 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.987881 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.988087 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.988173 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.988394 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.988479 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.988699 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.988794 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.989015 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.989101 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.989330 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.989416 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.989641 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.989736 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.989935 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.990021 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.990232 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.990355 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.990527 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.990693 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.990850 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.991017 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.991160 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.991339 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.991982 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.992167 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.992282 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.992492 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.992580 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.992819 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.992919 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.993131 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.993257 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.993425 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.993510 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.993718 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.993803 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.994010 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.994096 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.994307 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.994394 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.994599 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.994718 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.994913 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.995042 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.995205 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.995352 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.995497 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.995657 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.995788 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.995963 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.996080 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.996378 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.996475 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.996676 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.996969 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.997138 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.997266 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.997544 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.997698 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.997845 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.998141 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.998298 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.998456 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.998739 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.998909 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.999067 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.999248 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.999387 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.999571 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.999742 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:22.999894 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.000042 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.000191 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.000337 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.000483 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.000657 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.000804 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.000959 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.001115 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.001257 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.001399 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.001518 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.001646 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.001788 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.001951 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.002085 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.002257 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.002380 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.002578 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.002775 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.002903 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.003126 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.003287 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.003504 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.003654 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.003840 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.003981 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.004132 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.004265 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.004403 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.004528 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.004700 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.004833 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.005064 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.005236 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.005364 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.005580 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.005720 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.005898 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.006044 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.006186 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.006317 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.006488 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.006670 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.006983 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.007208 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.007824 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.007918 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.008135 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.008223 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.008445 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.008542 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.008754 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.008851 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.009059 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.009147 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.009367 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.009455 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.009676 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.009763 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.009996 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.010083 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.010327 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.010414 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.010666 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.010759 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.010985 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.011086 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.011299 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.011387 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.011629 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.011723 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.011962 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.012200 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.012319 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.012416 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.012693 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.012782 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.012871 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.012958 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.013195 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.013284 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.013488 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.013573 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.013726 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 11:41:23.013814 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.014124 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.014437 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.014773 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.015086 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.015400 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.015712 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.016027 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.016336 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.016647 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.016961 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.017277 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.017605 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.017933 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.018245 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.018571 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.018918 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.019268 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.019581 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.019930 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.020259 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.020678 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.021001 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.021310 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:41:23.021555 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 11:41:23.166452 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO dbcounter [None req-2478e14a-d0e6-4e4d-b562-39a1702e9cd5 None None] Registered counter for database nova_api Aug 12 11:41:23.174216 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO dbcounter [None req-9e70fe41-9625-467c-9e3d-5e97d7fc1185 None None] Registered counter for database nova_api Aug 12 11:41:23.188300 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_db.sqlalchemy.engines [None req-2478e14a-d0e6-4e4d-b562-39a1702e9cd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 11:41:23.194559 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG oslo_db.sqlalchemy.engines [None req-9e70fe41-9625-467c-9e3d-5e97d7fc1185 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 11:41:23.194825 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG dbcounter [-] [117199] Writer thread running {{(pid=117199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 11:41:23.201108 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG dbcounter [-] [117198] Writer thread running {{(pid=117198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 11:41:23.250326 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.context [None req-2478e14a-d0e6-4e4d-b562-39a1702e9cd5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b9c220d7-2838-4982-b405-2795c460dd82(cell1) {{(pid=117199) load_cells /opt/stack/nova/nova/context.py:464}} Aug 12 11:41:23.254167 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-2478e14a-d0e6-4e4d-b562-39a1702e9cd5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:41:23.254652 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-2478e14a-d0e6-4e4d-b562-39a1702e9cd5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:41:23.256180 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-2478e14a-d0e6-4e4d-b562-39a1702e9cd5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:41:23.256915 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-2478e14a-d0e6-4e4d-b562-39a1702e9cd5 None None] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:41:23.257434 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-2478e14a-d0e6-4e4d-b562-39a1702e9cd5 None None] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:41:23.257608 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.context [None req-9e70fe41-9625-467c-9e3d-5e97d7fc1185 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b9c220d7-2838-4982-b405-2795c460dd82(cell1) {{(pid=117198) load_cells /opt/stack/nova/nova/context.py:464}} Aug 12 11:41:23.259383 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-2478e14a-d0e6-4e4d-b562-39a1702e9cd5 None None] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:41:23.261330 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO dbcounter [None req-2478e14a-d0e6-4e4d-b562-39a1702e9cd5 None None] Registered counter for database nova_cell0 Aug 12 11:41:23.261418 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG oslo_concurrency.lockutils [None req-9e70fe41-9625-467c-9e3d-5e97d7fc1185 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:41:23.261877 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG oslo_concurrency.lockutils [None req-9e70fe41-9625-467c-9e3d-5e97d7fc1185 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:41:23.263479 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG oslo_concurrency.lockutils [None req-9e70fe41-9625-467c-9e3d-5e97d7fc1185 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:41:23.264225 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG oslo_concurrency.lockutils [None req-9e70fe41-9625-467c-9e3d-5e97d7fc1185 None None] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:41:23.264671 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG oslo_concurrency.lockutils [None req-9e70fe41-9625-467c-9e3d-5e97d7fc1185 None None] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:41:23.266556 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO dbcounter [None req-2478e14a-d0e6-4e4d-b562-39a1702e9cd5 None None] Registered counter for database nova_cell1 Aug 12 11:41:23.266797 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG oslo_concurrency.lockutils [None req-9e70fe41-9625-467c-9e3d-5e97d7fc1185 None None] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:41:23.268841 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO dbcounter [None req-9e70fe41-9625-467c-9e3d-5e97d7fc1185 None None] Registered counter for database nova_cell0 Aug 12 11:41:23.274192 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_db.sqlalchemy.engines [None req-2478e14a-d0e6-4e4d-b562-39a1702e9cd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 11:41:23.274446 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO dbcounter [None req-9e70fe41-9625-467c-9e3d-5e97d7fc1185 None None] Registered counter for database nova_cell1 Aug 12 11:41:23.276441 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_db.sqlalchemy.engines [None req-2478e14a-d0e6-4e4d-b562-39a1702e9cd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 11:41:23.281476 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG oslo_db.sqlalchemy.engines [None req-9e70fe41-9625-467c-9e3d-5e97d7fc1185 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 11:41:23.283113 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG dbcounter [-] [117199] Writer thread running {{(pid=117199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 11:41:23.284842 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG dbcounter [-] [117199] Writer thread running {{(pid=117199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 11:41:23.285207 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG oslo_db.sqlalchemy.engines [None req-9e70fe41-9625-467c-9e3d-5e97d7fc1185 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 11:41:23.286745 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG dbcounter [-] [117198] Writer thread running {{(pid=117198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 11:41:23.429603 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO dbcounter [None req-2478e14a-d0e6-4e4d-b562-39a1702e9cd5 None None] Registered counter for database nova_cell0 Aug 12 11:41:23.430350 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG dbcounter [-] [117198] Writer thread running {{(pid=117198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 11:41:23.436831 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_db.sqlalchemy.engines [None req-2478e14a-d0e6-4e4d-b562-39a1702e9cd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 11:41:23.439399 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO dbcounter [None req-9e70fe41-9625-467c-9e3d-5e97d7fc1185 None None] Registered counter for database nova_cell0 Aug 12 11:41:23.441057 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG dbcounter [-] [117199] Writer thread running {{(pid=117199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 11:41:23.448616 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG oslo_db.sqlalchemy.engines [None req-9e70fe41-9625-467c-9e3d-5e97d7fc1185 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 11:41:23.452892 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG dbcounter [-] [117198] Writer thread running {{(pid=117198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 11:41:23.780834 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: WARNING keystonemiddleware.auth_token [None req-2478e14a-d0e6-4e4d-b562-39a1702e9cd5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 11:41:23.788019 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: WARNING keystonemiddleware.auth_token [None req-2478e14a-d0e6-4e4d-b562-39a1702e9cd5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 11:41:23.792318 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: WARNING keystonemiddleware.auth_token [None req-9e70fe41-9625-467c-9e3d-5e97d7fc1185 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 11:41:23.799524 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: WARNING keystonemiddleware.auth_token [None req-9e70fe41-9625-467c-9e3d-5e97d7fc1185 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 11:41:24.127937 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: WARNING keystonemiddleware.auth_token [None req-2478e14a-d0e6-4e4d-b562-39a1702e9cd5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 11:41:24.134369 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: WARNING keystonemiddleware.auth_token [None req-2478e14a-d0e6-4e4d-b562-39a1702e9cd5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 11:41:24.139643 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bb16fb09c0 pid: 117199 (default app) Aug 12 11:41:24.141682 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-2478e14a-d0e6-4e4d-b562-39a1702e9cd5 None None] Calling method '>' {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:41:24.142874 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-2478e14a-d0e6-4e4d-b562-39a1702e9cd5 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001705 Aug 12 11:41:24.143281 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Fri Aug 12 11:41:24 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:41:24.143787 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: WARNING keystonemiddleware.auth_token [None req-9e70fe41-9625-467c-9e3d-5e97d7fc1185 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 11:41:24.150295 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: WARNING keystonemiddleware.auth_token [None req-9e70fe41-9625-467c-9e3d-5e97d7fc1185 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 11:41:24.155591 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bb16fb09c0 pid: 117198 (default app) Aug 12 11:42:41.756443 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-2478e14a-d0e6-4e4d-b562-39a1702e9cd5 None None] Calling method '>' {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:42:41.757985 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-2478e14a-d0e6-4e4d-b562-39a1702e9cd5 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001948 Aug 12 11:42:41.761105 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 931 bytes} [Fri Aug 12 11:42:41 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:42:41.770986 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG dbcounter [-] [117198] Writing DB stats nova_api:SELECT=3 {{(pid=117198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:41.772312 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG dbcounter [-] [117198] Writing DB stats nova_cell0:SELECT=3 {{(pid=117198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:41.773141 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG dbcounter [-] [117198] Writing DB stats nova_cell1:SELECT=3 {{(pid=117198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:41.774242 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG dbcounter [-] [117198] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:42.666877 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-af73b423-09ae-49c8-91ee-d8c0b88a2389 admin admin] Calling method '>' {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:42:42.698741 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-af73b423-09ae-49c8-91ee-d8c0b88a2389 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.933336 Aug 12 11:42:42.699565 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1292 bytes} [Fri Aug 12 11:42:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:42:45.128979 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-2478e14a-d0e6-4e4d-b562-39a1702e9cd5 None None] Calling method '>' {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:42:45.129967 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-2478e14a-d0e6-4e4d-b562-39a1702e9cd5 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001391 Aug 12 11:42:45.130519 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 931 bytes} [Fri Aug 12 11:42:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:42:45.565038 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-3badf173-9245-4052-b77c-ba595d11b995 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "ram": 256, "rxtx_factor": 1.0, "name": "cirros256", "disk": 1, "vcpus": 1}} {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:42:45.585831 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:42:45.585831 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: warnings.warn(msg) Aug 12 11:42:45.622389 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-3badf173-9245-4052-b77c-ba595d11b995 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.484927 Aug 12 11:42:45.623267 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1283 bytes} [Fri Aug 12 11:42:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 11:42:45.637324 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG dbcounter [-] [117199] Writing DB stats nova_api:SELECT=3 {{(pid=117199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:45.638269 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG dbcounter [-] [117199] Writing DB stats nova_cell0:SELECT=3 {{(pid=117199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:45.639395 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG dbcounter [-] [117199] Writing DB stats nova_cell1:SELECT=3 {{(pid=117199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:45.640381 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG dbcounter [-] [117199] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:45.845764 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-25fea22d-0465-4c44-bd3a-fc502ac85f1d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:42:45.849524 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:42:45.849524 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: warnings.warn(msg) Aug 12 11:42:45.909468 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-25fea22d-0465-4c44-bd3a-fc502ac85f1d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.277751 Aug 12 11:42:45.910047 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1336 bytes} [Fri Aug 12 11:42:45 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:42:48.259125 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-3badf173-9245-4052-b77c-ba595d11b995 admin admin] Calling method '>' {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:42:48.260142 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-3badf173-9245-4052-b77c-ba595d11b995 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 12 11:42:48.260731 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 931 bytes} [Fri Aug 12 11:42:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:42:48.913766 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-470d4d37-00ea-47c7-9b44-5753f2a8e797 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "swap": 0, "name": "ds512M"}} {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:42:48.932619 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:42:48.932619 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: warnings.warn(msg) Aug 12 11:42:48.953918 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-470d4d37-00ea-47c7-9b44-5753f2a8e797 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.686804 Aug 12 11:42:48.954466 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1283 bytes} [Fri Aug 12 11:42:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 11:42:48.967350 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-14da1448-76f7-47a8-9090-f9d8fe4accfe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:42:48.970195 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:42:48.970195 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: warnings.warn(msg) Aug 12 11:42:49.003537 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-14da1448-76f7-47a8-9090-f9d8fe4accfe admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039914 Aug 12 11:42:49.004380 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1336 bytes} [Fri Aug 12 11:42:48 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:42:51.359788 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-470d4d37-00ea-47c7-9b44-5753f2a8e797 admin admin] Calling method '>' {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:42:51.360820 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-470d4d37-00ea-47c7-9b44-5753f2a8e797 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 12 11:42:51.361385 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 931 bytes} [Fri Aug 12 11:42:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:42:51.761589 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-60378111-6dce-4678-9034-bf84ad3b8548 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "vcpus": 1, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds1G", "disk": 10, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:42:51.783033 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-60378111-6dce-4678-9034-bf84ad3b8548 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.415005 Aug 12 11:42:51.783559 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1283 bytes} [Fri Aug 12 11:42:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 11:42:51.795463 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-cb724b34-bf66-4bff-ac00-115f9c8e4451 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:42:51.818732 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-cb724b34-bf66-4bff-ac00-115f9c8e4451 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026859 Aug 12 11:42:51.819783 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1336 bytes} [Fri Aug 12 11:42:51 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:42:54.160357 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-60378111-6dce-4678-9034-bf84ad3b8548 admin admin] Calling method '>' {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:42:54.161293 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-60378111-6dce-4678-9034-bf84ad3b8548 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 12 11:42:54.161691 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 931 bytes} [Fri Aug 12 11:42:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:42:54.618863 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-13794cb3-e7f2-41f0-a1a5-dad51b63a53a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "id": "d3"}} {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:42:54.639403 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-13794cb3-e7f2-41f0-a1a5-dad51b63a53a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.471317 Aug 12 11:42:54.640243 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1283 bytes} [Fri Aug 12 11:42:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 11:42:54.652087 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-8d0b6145-659e-4e89-8410-94a6beb5f3e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:42:54.681552 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-8d0b6145-659e-4e89-8410-94a6beb5f3e9 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032980 Aug 12 11:42:54.684951 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1336 bytes} [Fri Aug 12 11:42:54 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:42:57.030570 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-13794cb3-e7f2-41f0-a1a5-dad51b63a53a admin admin] Calling method '>' {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:42:57.031601 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-13794cb3-e7f2-41f0-a1a5-dad51b63a53a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 12 11:42:57.032001 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 931 bytes} [Fri Aug 12 11:42:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:42:57.469051 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-9f75f36e-1ac8-408b-87b5-db0ab610bf90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "id": "d4", "disk": 20, "name": "ds4G", "os-flavor-access:is_public": true}} {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:42:57.488668 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-9f75f36e-1ac8-408b-87b5-db0ab610bf90 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.450577 Aug 12 11:42:57.489407 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1283 bytes} [Fri Aug 12 11:42:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 11:42:57.501571 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-684adc4f-d950-4231-92e1-b3037e05628f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:42:57.527628 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-684adc4f-d950-4231-92e1-b3037e05628f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029585 Aug 12 11:42:57.528430 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1336 bytes} [Fri Aug 12 11:42:57 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:43:00.176351 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-9f75f36e-1ac8-408b-87b5-db0ab610bf90 admin admin] Calling method '>' {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:00.177292 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-9f75f36e-1ac8-408b-87b5-db0ab610bf90 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 12 11:43:00.177695 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 931 bytes} [Fri Aug 12 11:43:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:43:00.616848 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-3b73dfaf-0679-489a-8466-cc7a8d083b43 admin admin] Calling method '>' {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:00.641105 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-3b73dfaf-0679-489a-8466-cc7a8d083b43 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.456739 Aug 12 11:43:00.641650 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1292 bytes} [Fri Aug 12 11:43:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:43:03.248665 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-9f75f36e-1ac8-408b-87b5-db0ab610bf90 admin admin] Calling method '>' {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:03.249676 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-9f75f36e-1ac8-408b-87b5-db0ab610bf90 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 12 11:43:03.250075 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 931 bytes} [Fri Aug 12 11:43:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:43:03.695035 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-ac87cebb-1d22-4a70-b8c7-51801575bdc2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "disk": 1, "ram": 512}} {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:43:03.717065 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-ac87cebb-1d22-4a70-b8c7-51801575bdc2 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.460567 Aug 12 11:43:03.718041 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1283 bytes} [Fri Aug 12 11:43:03 2022] POST /compute/v2.1/flavors => generated 402 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 11:43:03.729995 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-0c8d65a0-3c14-4a89-825f-a0a5ac7321f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:43:03.755504 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-0c8d65a0-3c14-4a89-825f-a0a5ac7321f9 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029194 Aug 12 11:43:03.756067 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1333 bytes} [Fri Aug 12 11:43:03 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:43:06.065565 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-ac87cebb-1d22-4a70-b8c7-51801575bdc2 admin admin] Calling method '>' {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:06.066578 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-ac87cebb-1d22-4a70-b8c7-51801575bdc2 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 12 11:43:06.067010 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 931 bytes} [Fri Aug 12 11:43:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:43:06.461966 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-8765cf8f-2b5d-41ab-a2b3-2c261febad82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small", "swap": 0, "disk": 20, "os-flavor-access:is_public": true, "ram": 2048, "id": "2"}} {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:43:06.480785 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-8765cf8f-2b5d-41ab-a2b3-2c261febad82 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.407625 Aug 12 11:43:06.481335 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1283 bytes} [Fri Aug 12 11:43:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 11:43:06.499090 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-c9b3637f-7cca-44a9-a174-402d93cde6ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:43:06.524154 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-c9b3637f-7cca-44a9-a174-402d93cde6ca admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028845 Aug 12 11:43:06.524715 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1333 bytes} [Fri Aug 12 11:43:06 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:43:08.859450 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-8765cf8f-2b5d-41ab-a2b3-2c261febad82 admin admin] Calling method '>' {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:08.861182 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-8765cf8f-2b5d-41ab-a2b3-2c261febad82 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002177 Aug 12 11:43:08.861927 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 931 bytes} [Fri Aug 12 11:43:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:43:09.299533 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-74ebd170-504e-4547-ba75-45e39ffc3184 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "vcpus": 2, "name": "m1.medium"}} {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:43:09.321778 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-74ebd170-504e-4547-ba75-45e39ffc3184 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.447479 Aug 12 11:43:09.322326 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1283 bytes} [Fri Aug 12 11:43:08 2022] POST /compute/v2.1/flavors => generated 406 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 11:43:09.334231 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-f5c5f221-d394-4c3e-93b3-acc49f7529e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:43:09.363612 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-f5c5f221-d394-4c3e-93b3-acc49f7529e1 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033003 Aug 12 11:43:09.364626 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1333 bytes} [Fri Aug 12 11:43:09 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:43:11.766640 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-74ebd170-504e-4547-ba75-45e39ffc3184 admin admin] Calling method '>' {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:11.767656 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-74ebd170-504e-4547-ba75-45e39ffc3184 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 12 11:43:11.768312 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 931 bytes} [Fri Aug 12 11:43:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:43:12.242427 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-ba915183-2ec4-4c38-8b95-a88a29230a91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.large", "id": "4", "ram": 8192, "vcpus": 4, "disk": 80, "rxtx_factor": 1.0, "swap": 0}} {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:43:12.248025 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG dbcounter [-] [117198] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=117198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:12.263710 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-ba915183-2ec4-4c38-8b95-a88a29230a91 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.488918 Aug 12 11:43:12.264264 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1283 bytes} [Fri Aug 12 11:43:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 11:43:12.276878 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-b9a4fee5-8f6a-4748-a78f-3229f22d557c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:43:12.301253 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-b9a4fee5-8f6a-4748-a78f-3229f22d557c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028095 Aug 12 11:43:12.301818 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1333 bytes} [Fri Aug 12 11:43:12 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:43:14.645504 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-ba915183-2ec4-4c38-8b95-a88a29230a91 admin admin] Calling method '>' {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:14.647832 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-ba915183-2ec4-4c38-8b95-a88a29230a91 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002781 Aug 12 11:43:14.648710 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 931 bytes} [Fri Aug 12 11:43:14 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:43:15.156035 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-5118ee9a-2b8f-47af-ae51-385e59adf8bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "ram": 16384, "os-flavor-access:is_public": true, "id": "5", "swap": 0, "vcpus": 8, "name": "m1.xlarge"}} {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:43:15.175660 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-5118ee9a-2b8f-47af-ae51-385e59adf8bd admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.520402 Aug 12 11:43:15.176376 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1283 bytes} [Fri Aug 12 11:43:14 2022] POST /compute/v2.1/flavors => generated 408 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 11:43:15.189176 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-266b81d6-7f60-4269-b408-6378ac1cb952 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:43:15.213958 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-266b81d6-7f60-4269-b408-6378ac1cb952 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028718 Aug 12 11:43:15.214520 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1333 bytes} [Fri Aug 12 11:43:15 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:43:33.841483 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-5118ee9a-2b8f-47af-ae51-385e59adf8bd admin admin] Calling method '>' {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:33.842482 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-5118ee9a-2b8f-47af-ae51-385e59adf8bd admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 12 11:43:33.842934 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 931 bytes} [Fri Aug 12 11:43:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:43:33.853928 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG dbcounter [-] [117198] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=117198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:34.228966 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-edf42025-7b80-4aec-bd34-fb967c76614c admin admin] Calling method '>' {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:34.246972 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-edf42025-7b80-4aec-bd34-fb967c76614c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.397496 Aug 12 11:43:34.247501 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1292 bytes} [Fri Aug 12 11:43:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:43:35.294338 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-5118ee9a-2b8f-47af-ae51-385e59adf8bd admin admin] Calling method '>' {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:35.295381 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-5118ee9a-2b8f-47af-ae51-385e59adf8bd admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 12 11:43:35.295780 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Aug 12 11:43:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:43:35.814901 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-d5813479-4bee-45ac-a7ef-3ec500e34fde admin admin] Calling method '>' {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:35.820390 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.wsgi [None req-d5813479-4bee-45ac-a7ef-3ec500e34fde admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 12 11:43:35.823595 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-d5813479-4bee-45ac-a7ef-3ec500e34fde admin admin] Request method failure captured: Aug 12 11:43:35.823595 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 12 11:43:35.823595 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: Accept: application/json Aug 12 11:43:35.823595 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: Accept-Encoding: gzip, deflate Aug 12 11:43:35.823595 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: Connection: keep-alive Aug 12 11:43:35.823595 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: Content-Length: 0 Aug 12 11:43:35.823595 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: Host: 10.222.0.42 Aug 12 11:43:35.823595 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: Openstack-Api-Version: compute 2.90 Aug 12 11:43:35.823595 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: Openstack-System-Scope: None Aug 12 11:43:35.823595 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: User-Agent: python-novaclient Aug 12 11:43:35.823595 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Auth-Token: gAAAAABi9jzn0manWPdwk1LVekJUDGjy4RZUtzCHkaawXkXCduCfrlZDzOxgd2f1yWq4smbNctKII2o3fCERu_CRxGlPtNUSYXEXOKlEXp83wrrSFl0Dj9_g0uYymY_RYfKNNWFTqD1EeMg8aDaCMYedT5-lDtebqA2G1_26FxjHtmcHYsW8Zss Aug 12 11:43:35.823595 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Domain-Id: None Aug 12 11:43:35.823595 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Domain-Name: None Aug 12 11:43:35.823595 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Identity-Status: Confirmed Aug 12 11:43:35.823595 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Is-Admin-Project: True Aug 12 11:43:35.823595 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 11:43:35.823595 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Project-Domain-Id: default Aug 12 11:43:35.823595 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Project-Domain-Name: Default Aug 12 11:43:35.823595 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Project-Id: eb962a2585ab4e27ac665ceb80fa0708 Aug 12 11:43:35.823595 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Project-Name: admin Aug 12 11:43:35.823595 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Role: reader,admin,member Aug 12 11:43:35.823595 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Roles: reader,admin,member Aug 12 11:43:35.825151 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eb962a2585ab4e27ac665ceb80fa0708", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eb962a2585ab4e27ac665ceb80fa0708"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb962a2585ab4e27ac665ceb80fa0708"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb962a2585ab4e27ac665ceb80fa0708"}]}] Aug 12 11:43:35.825151 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Tenant: admin Aug 12 11:43:35.825151 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Tenant-Id: eb962a2585ab4e27ac665ceb80fa0708 Aug 12 11:43:35.825151 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Tenant-Name: admin Aug 12 11:43:35.825151 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-User: admin Aug 12 11:43:35.825151 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-User-Domain-Id: default Aug 12 11:43:35.825151 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-User-Domain-Name: Default Aug 12 11:43:35.825151 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-User-Id: 1a0b7676c79e47efbad45a84392bc86a Aug 12 11:43:35.825151 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-User-Name: admin Aug 12 11:43:35.825151 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: method: > Aug 12 11:43:35.825151 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: exception: Flavor 42 could not be found. Aug 12 11:43:35.825151 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: action_args: {'id': '42'} Aug 12 11:43:35.825151 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:43:35.825151 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:43:35.826209 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 11:43:35.826209 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 11:43:35.826209 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 11:43:35.826209 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 11:43:35.826209 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 11:43:35.826209 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 11:43:35.826209 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 11:43:35.826209 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 11:43:35.826209 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 11:43:35.826209 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:43:35.826209 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 11:43:35.826209 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 11:43:35.826209 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 12 11:43:35.826209 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi Aug 12 11:43:35.826209 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:43:35.826209 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi Aug 12 11:43:35.826209 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:43:35.826209 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:43:35.826209 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:43:35.827447 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:43:35.827447 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:43:35.827447 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:43:35.827447 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:43:35.827447 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 11:43:35.827447 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:43:35.827447 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 12 11:43:35.827447 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi Aug 12 11:43:35.827447 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:43:35.827447 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi Aug 12 11:43:35.827447 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:43:35.827447 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:43:35.827447 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:43:35.827447 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:43:35.827447 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:43:35.827447 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 12 11:43:35.827447 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi Aug 12 11:43:35.827447 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-d5813479-4bee-45ac-a7ef-3ec500e34fde admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:43:35.828491 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-d5813479-4bee-45ac-a7ef-3ec500e34fde admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.390092 Aug 12 11:43:35.828491 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Fri Aug 12 11:43:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 11:43:35.835217 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-37fbcc55-d5d3-4fe3-b81e-7bae9bafa556 admin admin] Calling method '>' {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:35.839315 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG dbcounter [-] [117199] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=117199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:35.859711 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-37fbcc55-d5d3-4fe3-b81e-7bae9bafa556 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028542 Aug 12 11:43:35.860269 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Aug 12 11:43:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:43:35.870095 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-018b12c7-46a8-4b67-9014-28b8f60939a8 admin admin] Calling method '>' {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:35.893278 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-018b12c7-46a8-4b67-9014-28b8f60939a8 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026733 Aug 12 11:43:35.893809 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Aug 12 11:43:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:43:35.904104 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-3c61329e-47b5-470e-a4ed-ddb77cd69f41 admin admin] Calling method '>' {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:35.911410 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.wsgi [None req-3c61329e-47b5-470e-a4ed-ddb77cd69f41 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 12 11:43:35.914649 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-3c61329e-47b5-470e-a4ed-ddb77cd69f41 admin admin] Request method failure captured: Aug 12 11:43:35.914649 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 12 11:43:35.914649 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: Accept: application/json Aug 12 11:43:35.914649 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: Accept-Encoding: gzip, deflate Aug 12 11:43:35.914649 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: Connection: keep-alive Aug 12 11:43:35.914649 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: Content-Length: 0 Aug 12 11:43:35.914649 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: Host: 10.222.0.42 Aug 12 11:43:35.914649 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: Openstack-Api-Version: compute 2.90 Aug 12 11:43:35.914649 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: Openstack-System-Scope: None Aug 12 11:43:35.914649 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: User-Agent: python-novaclient Aug 12 11:43:35.914649 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Auth-Token: gAAAAABi9jzn0manWPdwk1LVekJUDGjy4RZUtzCHkaawXkXCduCfrlZDzOxgd2f1yWq4smbNctKII2o3fCERu_CRxGlPtNUSYXEXOKlEXp83wrrSFl0Dj9_g0uYymY_RYfKNNWFTqD1EeMg8aDaCMYedT5-lDtebqA2G1_26FxjHtmcHYsW8Zss Aug 12 11:43:35.914649 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Domain-Id: None Aug 12 11:43:35.914649 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Domain-Name: None Aug 12 11:43:35.914649 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Identity-Status: Confirmed Aug 12 11:43:35.914649 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Is-Admin-Project: True Aug 12 11:43:35.914649 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 11:43:35.914649 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Project-Domain-Id: default Aug 12 11:43:35.914649 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Project-Domain-Name: Default Aug 12 11:43:35.914649 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Project-Id: eb962a2585ab4e27ac665ceb80fa0708 Aug 12 11:43:35.914649 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Project-Name: admin Aug 12 11:43:35.914649 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Role: reader,admin,member Aug 12 11:43:35.914649 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Roles: reader,admin,member Aug 12 11:43:35.915973 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eb962a2585ab4e27ac665ceb80fa0708", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eb962a2585ab4e27ac665ceb80fa0708"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb962a2585ab4e27ac665ceb80fa0708"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb962a2585ab4e27ac665ceb80fa0708"}]}] Aug 12 11:43:35.915973 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Tenant: admin Aug 12 11:43:35.915973 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Tenant-Id: eb962a2585ab4e27ac665ceb80fa0708 Aug 12 11:43:35.915973 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Tenant-Name: admin Aug 12 11:43:35.915973 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-User: admin Aug 12 11:43:35.915973 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-User-Domain-Id: default Aug 12 11:43:35.915973 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-User-Domain-Name: Default Aug 12 11:43:35.915973 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-User-Id: 1a0b7676c79e47efbad45a84392bc86a Aug 12 11:43:35.915973 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-User-Name: admin Aug 12 11:43:35.915973 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: method: > Aug 12 11:43:35.915973 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: exception: Flavor 42 could not be found. Aug 12 11:43:35.915973 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: action_args: {'id': '42'} Aug 12 11:43:35.915973 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:43:35.915973 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:43:35.916797 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 11:43:35.916797 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 11:43:35.916797 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 11:43:35.916797 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 11:43:35.916797 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 11:43:35.916797 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 11:43:35.916797 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 11:43:35.916797 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 11:43:35.916797 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 11:43:35.916797 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:43:35.916797 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 11:43:35.916797 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 11:43:35.916797 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 12 11:43:35.916797 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi Aug 12 11:43:35.916797 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:43:35.916797 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi Aug 12 11:43:35.916797 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:43:35.916797 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:43:35.916797 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:43:35.918037 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:43:35.918037 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:43:35.918037 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:43:35.918037 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:43:35.918037 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 11:43:35.918037 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:43:35.918037 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 12 11:43:35.918037 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi Aug 12 11:43:35.918037 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:43:35.918037 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi Aug 12 11:43:35.918037 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:43:35.918037 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:43:35.918037 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:43:35.918037 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:43:35.918037 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:43:35.918037 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 12 11:43:35.918037 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi Aug 12 11:43:35.918037 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-3c61329e-47b5-470e-a4ed-ddb77cd69f41 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:43:35.919262 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-3c61329e-47b5-470e-a4ed-ddb77cd69f41 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015861 Aug 12 11:43:35.919262 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Fri Aug 12 11:43:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 11:43:36.874054 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-018b12c7-46a8-4b67-9014-28b8f60939a8 admin admin] Calling method '>' {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:36.875099 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-018b12c7-46a8-4b67-9014-28b8f60939a8 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Aug 12 11:43:36.875494 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Aug 12 11:43:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:43:37.389641 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-5c2179c7-94eb-4c02-bc44-b44b13db5e29 admin admin] Calling method '>' {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:37.394918 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.wsgi [None req-5c2179c7-94eb-4c02-bc44-b44b13db5e29 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 12 11:43:37.396393 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-5c2179c7-94eb-4c02-bc44-b44b13db5e29 admin admin] Request method failure captured: Aug 12 11:43:37.396393 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 12 11:43:37.396393 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: Accept: application/json Aug 12 11:43:37.396393 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: Accept-Encoding: gzip, deflate Aug 12 11:43:37.396393 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: Connection: keep-alive Aug 12 11:43:37.396393 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: Content-Length: 0 Aug 12 11:43:37.396393 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: Host: 10.222.0.42 Aug 12 11:43:37.396393 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: Openstack-Api-Version: compute 2.90 Aug 12 11:43:37.396393 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: Openstack-System-Scope: None Aug 12 11:43:37.396393 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: User-Agent: python-novaclient Aug 12 11:43:37.396393 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Auth-Token: gAAAAABi9jzoC1fPfPNEkvkpCsOflnCJcpebnlTmT9YxH0mfgm1YyR6VmquHeFZ-X5jWy7ZVgSGtEolTtkIrT2xIKhhucjSDFywRTEcWzgCUbKI3We9TlYcHgbxEKkg5bdMQPXoo5afFrnPytefySq1x5f7PaJlcr7Pdagx1WfXwF6k2LT7OYsE Aug 12 11:43:37.396393 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Domain-Id: None Aug 12 11:43:37.396393 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Domain-Name: None Aug 12 11:43:37.396393 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Identity-Status: Confirmed Aug 12 11:43:37.396393 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Is-Admin-Project: True Aug 12 11:43:37.396393 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 11:43:37.396393 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Project-Domain-Id: default Aug 12 11:43:37.396393 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Project-Domain-Name: Default Aug 12 11:43:37.396393 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Project-Id: eb962a2585ab4e27ac665ceb80fa0708 Aug 12 11:43:37.396393 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Project-Name: admin Aug 12 11:43:37.396393 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Role: reader,admin,member Aug 12 11:43:37.396393 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Roles: reader,admin,member Aug 12 11:43:37.397896 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eb962a2585ab4e27ac665ceb80fa0708", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eb962a2585ab4e27ac665ceb80fa0708"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb962a2585ab4e27ac665ceb80fa0708"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb962a2585ab4e27ac665ceb80fa0708"}]}] Aug 12 11:43:37.397896 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Tenant: admin Aug 12 11:43:37.397896 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Tenant-Id: eb962a2585ab4e27ac665ceb80fa0708 Aug 12 11:43:37.397896 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Tenant-Name: admin Aug 12 11:43:37.397896 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-User: admin Aug 12 11:43:37.397896 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-User-Domain-Id: default Aug 12 11:43:37.397896 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-User-Domain-Name: Default Aug 12 11:43:37.397896 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-User-Id: 1a0b7676c79e47efbad45a84392bc86a Aug 12 11:43:37.397896 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-User-Name: admin Aug 12 11:43:37.397896 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: method: > Aug 12 11:43:37.397896 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: exception: Flavor 84 could not be found. Aug 12 11:43:37.397896 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: action_args: {'id': '84'} Aug 12 11:43:37.397896 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:43:37.397896 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:43:37.398887 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 11:43:37.398887 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 11:43:37.398887 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 11:43:37.398887 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 11:43:37.398887 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 11:43:37.398887 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 11:43:37.398887 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 11:43:37.398887 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 11:43:37.398887 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 11:43:37.398887 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:43:37.398887 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 11:43:37.398887 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 11:43:37.398887 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 12 11:43:37.398887 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi Aug 12 11:43:37.398887 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:43:37.398887 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi Aug 12 11:43:37.398887 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:43:37.398887 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:43:37.398887 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:43:37.400134 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:43:37.400134 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:43:37.400134 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:43:37.400134 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:43:37.400134 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 11:43:37.400134 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:43:37.400134 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 12 11:43:37.400134 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi Aug 12 11:43:37.400134 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:43:37.400134 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi Aug 12 11:43:37.400134 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:43:37.400134 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:43:37.400134 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:43:37.400134 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:43:37.400134 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:43:37.400134 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 12 11:43:37.400134 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi Aug 12 11:43:37.400134 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-5c2179c7-94eb-4c02-bc44-b44b13db5e29 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:43:37.401603 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-5c2179c7-94eb-4c02-bc44-b44b13db5e29 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.386100 Aug 12 11:43:37.401603 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Fri Aug 12 11:43:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 11:43:37.407336 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-2a9667fd-d400-46e5-918a-e072e3bb818e admin admin] Calling method '>' {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:37.422257 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-2a9667fd-d400-46e5-918a-e072e3bb818e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018427 Aug 12 11:43:37.422808 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Aug 12 11:43:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:43:37.432497 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-1b3cd993-4e8c-46aa-b0c7-4d674c03a853 admin admin] Calling method '>' {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:37.447599 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-1b3cd993-4e8c-46aa-b0c7-4d674c03a853 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018579 Aug 12 11:43:37.448110 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Aug 12 11:43:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:43:37.456879 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-206d5bbf-38b1-4954-99c1-2dafd48e8612 admin admin] Calling method '>' {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:37.461912 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.wsgi [None req-206d5bbf-38b1-4954-99c1-2dafd48e8612 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 12 11:43:37.463398 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-206d5bbf-38b1-4954-99c1-2dafd48e8612 admin admin] Request method failure captured: Aug 12 11:43:37.463398 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 12 11:43:37.463398 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: Accept: application/json Aug 12 11:43:37.463398 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: Accept-Encoding: gzip, deflate Aug 12 11:43:37.463398 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: Connection: keep-alive Aug 12 11:43:37.463398 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: Content-Length: 0 Aug 12 11:43:37.463398 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: Host: 10.222.0.42 Aug 12 11:43:37.463398 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: Openstack-Api-Version: compute 2.90 Aug 12 11:43:37.463398 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: Openstack-System-Scope: None Aug 12 11:43:37.463398 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: User-Agent: python-novaclient Aug 12 11:43:37.463398 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Auth-Token: gAAAAABi9jzoC1fPfPNEkvkpCsOflnCJcpebnlTmT9YxH0mfgm1YyR6VmquHeFZ-X5jWy7ZVgSGtEolTtkIrT2xIKhhucjSDFywRTEcWzgCUbKI3We9TlYcHgbxEKkg5bdMQPXoo5afFrnPytefySq1x5f7PaJlcr7Pdagx1WfXwF6k2LT7OYsE Aug 12 11:43:37.463398 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Domain-Id: None Aug 12 11:43:37.463398 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Domain-Name: None Aug 12 11:43:37.463398 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Identity-Status: Confirmed Aug 12 11:43:37.463398 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Is-Admin-Project: True Aug 12 11:43:37.463398 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 11:43:37.463398 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Project-Domain-Id: default Aug 12 11:43:37.463398 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Project-Domain-Name: Default Aug 12 11:43:37.463398 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Project-Id: eb962a2585ab4e27ac665ceb80fa0708 Aug 12 11:43:37.463398 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Project-Name: admin Aug 12 11:43:37.463398 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Role: reader,admin,member Aug 12 11:43:37.463398 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Roles: reader,admin,member Aug 12 11:43:37.464911 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eb962a2585ab4e27ac665ceb80fa0708", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eb962a2585ab4e27ac665ceb80fa0708"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb962a2585ab4e27ac665ceb80fa0708"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb962a2585ab4e27ac665ceb80fa0708"}]}] Aug 12 11:43:37.464911 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Tenant: admin Aug 12 11:43:37.464911 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Tenant-Id: eb962a2585ab4e27ac665ceb80fa0708 Aug 12 11:43:37.464911 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Tenant-Name: admin Aug 12 11:43:37.464911 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-User: admin Aug 12 11:43:37.464911 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-User-Domain-Id: default Aug 12 11:43:37.464911 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-User-Domain-Name: Default Aug 12 11:43:37.464911 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-User-Id: 1a0b7676c79e47efbad45a84392bc86a Aug 12 11:43:37.464911 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-User-Name: admin Aug 12 11:43:37.464911 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: method: > Aug 12 11:43:37.464911 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: exception: Flavor 84 could not be found. Aug 12 11:43:37.464911 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: action_args: {'id': '84'} Aug 12 11:43:37.464911 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:43:37.464911 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:43:37.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 11:43:37.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 11:43:37.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 11:43:37.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 11:43:37.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 11:43:37.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 11:43:37.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 11:43:37.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 11:43:37.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 11:43:37.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:43:37.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 11:43:37.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 11:43:37.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 12 11:43:37.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi Aug 12 11:43:37.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:43:37.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi Aug 12 11:43:37.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:43:37.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:43:37.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:43:37.467156 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:43:37.467156 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:43:37.467156 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:43:37.467156 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:43:37.467156 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 11:43:37.467156 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:43:37.467156 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 12 11:43:37.467156 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi Aug 12 11:43:37.467156 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:43:37.467156 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi Aug 12 11:43:37.467156 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:43:37.467156 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:43:37.467156 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:43:37.467156 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:43:37.467156 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:43:37.467156 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 12 11:43:37.467156 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi Aug 12 11:43:37.467156 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-206d5bbf-38b1-4954-99c1-2dafd48e8612 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:43:37.468175 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-206d5bbf-38b1-4954-99c1-2dafd48e8612 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011181 Aug 12 11:43:37.468175 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Fri Aug 12 11:43:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 11:43:38.437337 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-1b3cd993-4e8c-46aa-b0c7-4d674c03a853 admin admin] Calling method '>' {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:38.438334 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-1b3cd993-4e8c-46aa-b0c7-4d674c03a853 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Aug 12 11:43:38.438753 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Aug 12 11:43:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:43:38.960784 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-034ca03b-0522-4d4e-b42e-4d605cee129c admin admin] Calling method '>' {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:38.966476 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.wsgi [None req-034ca03b-0522-4d4e-b42e-4d605cee129c admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 12 11:43:38.967975 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-034ca03b-0522-4d4e-b42e-4d605cee129c admin admin] Request method failure captured: Aug 12 11:43:38.967975 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 12 11:43:38.967975 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: Accept: application/json Aug 12 11:43:38.967975 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: Accept-Encoding: gzip, deflate Aug 12 11:43:38.967975 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: Connection: keep-alive Aug 12 11:43:38.967975 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: Content-Length: 0 Aug 12 11:43:38.967975 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: Host: 10.222.0.42 Aug 12 11:43:38.967975 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: Openstack-Api-Version: compute 2.90 Aug 12 11:43:38.967975 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: Openstack-System-Scope: None Aug 12 11:43:38.967975 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: User-Agent: python-novaclient Aug 12 11:43:38.967975 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Auth-Token: gAAAAABi9jzq_CYP168GN3JioFznr6pcpig7P1P7TyEi63Zz2a07x6meyiYwMFyRNZaJG2H614SEqmvIPhML1iAMXsrwEt6Ywk60rE1HNkkKx_1Ia48R5XMfP00iwek0x7V6xMxd8Ab7DV2ee_Ghc8NeaRHz9xINeP5mJUQDf3UqfvU5VNST5-Q Aug 12 11:43:38.967975 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Domain-Id: None Aug 12 11:43:38.967975 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Domain-Name: None Aug 12 11:43:38.967975 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Identity-Status: Confirmed Aug 12 11:43:38.967975 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Is-Admin-Project: True Aug 12 11:43:38.967975 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 11:43:38.967975 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Project-Domain-Id: default Aug 12 11:43:38.967975 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Project-Domain-Name: Default Aug 12 11:43:38.967975 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Project-Id: eb962a2585ab4e27ac665ceb80fa0708 Aug 12 11:43:38.967975 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Project-Name: admin Aug 12 11:43:38.967975 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Role: reader,admin,member Aug 12 11:43:38.967975 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Roles: reader,admin,member Aug 12 11:43:38.969491 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eb962a2585ab4e27ac665ceb80fa0708", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eb962a2585ab4e27ac665ceb80fa0708"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb962a2585ab4e27ac665ceb80fa0708"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb962a2585ab4e27ac665ceb80fa0708"}]}] Aug 12 11:43:38.969491 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Tenant: admin Aug 12 11:43:38.969491 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Tenant-Id: eb962a2585ab4e27ac665ceb80fa0708 Aug 12 11:43:38.969491 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-Tenant-Name: admin Aug 12 11:43:38.969491 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-User: admin Aug 12 11:43:38.969491 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-User-Domain-Id: default Aug 12 11:43:38.969491 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-User-Domain-Name: Default Aug 12 11:43:38.969491 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-User-Id: 1a0b7676c79e47efbad45a84392bc86a Aug 12 11:43:38.969491 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: X-User-Name: admin Aug 12 11:43:38.969491 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: method: > Aug 12 11:43:38.969491 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: exception: Flavor 451 could not be found. Aug 12 11:43:38.969491 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: action_args: {'id': '451'} Aug 12 11:43:38.969491 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:43:38.969491 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:43:38.971428 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 11:43:38.971428 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 11:43:38.971428 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 11:43:38.971428 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 11:43:38.971428 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 11:43:38.971428 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 11:43:38.971428 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 11:43:38.971428 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 11:43:38.971428 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 11:43:38.971428 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:43:38.971428 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 11:43:38.971428 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 11:43:38.971428 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 12 11:43:38.971428 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi Aug 12 11:43:38.971428 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:43:38.971428 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi Aug 12 11:43:38.971428 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:43:38.971428 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:43:38.971428 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:43:38.973095 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:43:38.973095 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:43:38.973095 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:43:38.973095 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:43:38.973095 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 11:43:38.973095 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:43:38.973095 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 12 11:43:38.973095 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi Aug 12 11:43:38.973095 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:43:38.973095 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi Aug 12 11:43:38.973095 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:43:38.973095 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:43:38.973095 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:43:38.973095 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:43:38.973095 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:43:38.973095 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 12 11:43:38.973095 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: ERROR nova.api.openstack.wsgi Aug 12 11:43:38.973095 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-034ca03b-0522-4d4e-b42e-4d605cee129c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:43:38.974229 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-034ca03b-0522-4d4e-b42e-4d605cee129c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.393731 Aug 12 11:43:38.974229 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Aug 12 11:43:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 11:43:38.979422 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-c19171ab-5a9a-4556-a1d2-b2bca222248e admin admin] Calling method '>' {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:38.994981 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-c19171ab-5a9a-4556-a1d2-b2bca222248e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019110 Aug 12 11:43:38.995511 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Aug 12 11:43:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:43:39.004827 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-1dbabd71-c5fb-45ee-a52c-c578210af248 admin admin] Calling method '>' {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:39.019323 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-1dbabd71-c5fb-45ee-a52c-c578210af248 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018042 Aug 12 11:43:39.019833 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Aug 12 11:43:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:43:39.028794 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-3b6fe641-ba94-4e69-b823-64d7ec28c705 admin admin] Calling method '>' {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:39.033973 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.wsgi [None req-3b6fe641-ba94-4e69-b823-64d7ec28c705 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 12 11:43:39.035983 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-3b6fe641-ba94-4e69-b823-64d7ec28c705 admin admin] Request method failure captured: Aug 12 11:43:39.035983 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 12 11:43:39.035983 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: Accept: application/json Aug 12 11:43:39.035983 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: Accept-Encoding: gzip, deflate Aug 12 11:43:39.035983 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: Connection: keep-alive Aug 12 11:43:39.035983 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: Content-Length: 0 Aug 12 11:43:39.035983 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: Host: 10.222.0.42 Aug 12 11:43:39.035983 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: Openstack-Api-Version: compute 2.90 Aug 12 11:43:39.035983 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: Openstack-System-Scope: None Aug 12 11:43:39.035983 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: User-Agent: python-novaclient Aug 12 11:43:39.035983 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Auth-Token: gAAAAABi9jzq_CYP168GN3JioFznr6pcpig7P1P7TyEi63Zz2a07x6meyiYwMFyRNZaJG2H614SEqmvIPhML1iAMXsrwEt6Ywk60rE1HNkkKx_1Ia48R5XMfP00iwek0x7V6xMxd8Ab7DV2ee_Ghc8NeaRHz9xINeP5mJUQDf3UqfvU5VNST5-Q Aug 12 11:43:39.035983 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Domain-Id: None Aug 12 11:43:39.035983 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Domain-Name: None Aug 12 11:43:39.035983 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Identity-Status: Confirmed Aug 12 11:43:39.035983 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Is-Admin-Project: True Aug 12 11:43:39.035983 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 11:43:39.035983 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Project-Domain-Id: default Aug 12 11:43:39.035983 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Project-Domain-Name: Default Aug 12 11:43:39.035983 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Project-Id: eb962a2585ab4e27ac665ceb80fa0708 Aug 12 11:43:39.035983 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Project-Name: admin Aug 12 11:43:39.035983 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Role: reader,admin,member Aug 12 11:43:39.035983 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Roles: reader,admin,member Aug 12 11:43:39.037405 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eb962a2585ab4e27ac665ceb80fa0708", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eb962a2585ab4e27ac665ceb80fa0708"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb962a2585ab4e27ac665ceb80fa0708"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb962a2585ab4e27ac665ceb80fa0708"}]}] Aug 12 11:43:39.037405 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Tenant: admin Aug 12 11:43:39.037405 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Tenant-Id: eb962a2585ab4e27ac665ceb80fa0708 Aug 12 11:43:39.037405 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-Tenant-Name: admin Aug 12 11:43:39.037405 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-User: admin Aug 12 11:43:39.037405 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-User-Domain-Id: default Aug 12 11:43:39.037405 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-User-Domain-Name: Default Aug 12 11:43:39.037405 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-User-Id: 1a0b7676c79e47efbad45a84392bc86a Aug 12 11:43:39.037405 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: X-User-Name: admin Aug 12 11:43:39.037405 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: method: > Aug 12 11:43:39.037405 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: exception: Flavor 451 could not be found. Aug 12 11:43:39.037405 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: action_args: {'id': '451'} Aug 12 11:43:39.037405 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:43:39.037405 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:43:39.038188 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 11:43:39.038188 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 11:43:39.038188 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 11:43:39.038188 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 11:43:39.038188 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 11:43:39.038188 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 11:43:39.038188 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 11:43:39.038188 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 11:43:39.038188 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 11:43:39.038188 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:43:39.038188 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 11:43:39.038188 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 11:43:39.038188 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 12 11:43:39.038188 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi Aug 12 11:43:39.038188 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:43:39.038188 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi Aug 12 11:43:39.038188 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:43:39.038188 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:43:39.038188 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:43:39.039266 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:43:39.039266 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:43:39.039266 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:43:39.039266 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:43:39.039266 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 11:43:39.039266 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:43:39.039266 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 12 11:43:39.039266 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi Aug 12 11:43:39.039266 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:43:39.039266 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi Aug 12 11:43:39.039266 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:43:39.039266 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:43:39.039266 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:43:39.039266 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:43:39.039266 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:43:39.039266 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 12 11:43:39.039266 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: ERROR nova.api.openstack.wsgi Aug 12 11:43:39.039266 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-3b6fe641-ba94-4e69-b823-64d7ec28c705 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:43:39.040297 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-3b6fe641-ba94-4e69-b823-64d7ec28c705 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011962 Aug 12 11:43:39.040297 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Aug 12 11:43:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 11:43:40.028032 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-1dbabd71-c5fb-45ee-a52c-c578210af248 admin admin] Calling method '>' {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:40.029038 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-1dbabd71-c5fb-45ee-a52c-c578210af248 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 12 11:43:40.029428 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Aug 12 11:43:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:43:40.548049 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-bd41a842-351a-443a-8c83-bcf2ff2e550f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:43:40.568145 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-bd41a842-351a-443a-8c83-bcf2ff2e550f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.400177 Aug 12 11:43:40.568695 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Fri Aug 12 11:43:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 11:43:41.543529 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-1dbabd71-c5fb-45ee-a52c-c578210af248 admin admin] Calling method '>' {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:41.544535 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-1dbabd71-c5fb-45ee-a52c-c578210af248 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Aug 12 11:43:41.544931 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Aug 12 11:43:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:43:42.069540 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-cb6a88c9-fa9f-4d06-aed5-4a18ce136924 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:43:42.087478 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-cb6a88c9-fa9f-4d06-aed5-4a18ce136924 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.407960 Aug 12 11:43:42.087950 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Fri Aug 12 11:43:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 11:43:43.045849 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-1dbabd71-c5fb-45ee-a52c-c578210af248 admin admin] Calling method '>' {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:43.046875 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-1dbabd71-c5fb-45ee-a52c-c578210af248 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 12 11:43:43.047267 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Aug 12 11:43:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:43:43.563695 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-3e37956f-c736-4a3d-b42a-a2fea67d9f98 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:43:43.582644 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-3e37956f-c736-4a3d-b42a-a2fea67d9f98 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.398509 Aug 12 11:43:43.583164 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Fri Aug 12 11:43:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 12 11:43:44.540753 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-1dbabd71-c5fb-45ee-a52c-c578210af248 admin admin] Calling method '>' {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:44.541760 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-1dbabd71-c5fb-45ee-a52c-c578210af248 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Aug 12 11:43:44.542150 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Aug 12 11:43:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:43:45.061971 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-66e1b8bd-3fc7-4e3c-9b46-cdc9dfe640a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:43:45.080075 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-66e1b8bd-3fc7-4e3c-9b46-cdc9dfe640a0 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.399357 Aug 12 11:43:45.080614 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Fri Aug 12 11:43:44 2022] POST /compute/v2.1/flavors => generated 409 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 11:43:46.102789 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-1dbabd71-c5fb-45ee-a52c-c578210af248 admin admin] Calling method '>' {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:46.103827 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-1dbabd71-c5fb-45ee-a52c-c578210af248 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 12 11:43:46.104217 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Aug 12 11:43:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:43:46.611610 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-11670c77-8e23-43b1-a0bf-57a60311e2f6 admin admin] Calling method '>' {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:43:46.632288 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-11670c77-8e23-43b1-a0bf-57a60311e2f6 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.393302 Aug 12 11:43:46.632811 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Fri Aug 12 11:43:46 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:44:39.232954 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-1dbabd71-c5fb-45ee-a52c-c578210af248 admin admin] Calling method '>' {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:44:39.233970 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-1dbabd71-c5fb-45ee-a52c-c578210af248 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 12 11:44:39.234393 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 931 bytes} [Fri Aug 12 11:44:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:44:39.244898 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG dbcounter [-] [117199] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=117199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:39.625675 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-caf95083-1b30-423b-ad9f-e704380230ca admin admin] Calling method '>' {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:44:39.653077 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-caf95083-1b30-423b-ad9f-e704380230ca admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.412561 Aug 12 11:44:39.653615 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1292 bytes} [Fri Aug 12 11:44:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:44:39.675283 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG dbcounter [-] [117198] Writing DB stats nova_api:SELECT=14 {{(pid=117198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:39.679371 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-44b8972f-485e-4c5d-9755-a59c5c4ff577 admin admin] Calling method '>' {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:44:39.687168 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-44b8972f-485e-4c5d-9755-a59c5c4ff577 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013324 Aug 12 11:44:39.687682 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1283 bytes} [Fri Aug 12 11:44:39 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:44:39.699307 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-fd2815b6-5ae7-40e4-ad22-b57acfa58ace admin admin] Calling method '>' {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:44:39.707003 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-fd2815b6-5ae7-40e4-ad22-b57acfa58ace admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011320 Aug 12 11:44:39.707509 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1286 bytes} [Fri Aug 12 11:44:39 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:44:39.719228 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-a4a4bb66-ec18-470c-ab80-73229213a069 admin admin] Calling method '>' {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:44:39.726728 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-a4a4bb66-ec18-470c-ab80-73229213a069 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011475 Aug 12 11:44:39.727238 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1286 bytes} [Fri Aug 12 11:44:39 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:44:39.739421 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-5f60b569-88bd-4151-90f6-830e395b52f7 admin admin] Calling method '>' {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:44:39.746952 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-5f60b569-88bd-4151-90f6-830e395b52f7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011438 Aug 12 11:44:39.747467 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1283 bytes} [Fri Aug 12 11:44:39 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:47:42.543584 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-a4a4bb66-ec18-470c-ab80-73229213a069 admin admin] Calling method '>' {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:47:42.544617 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-a4a4bb66-ec18-470c-ab80-73229213a069 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 12 11:47:42.545039 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Aug 12 11:47:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:47:42.683679 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG dbcounter [-] [117199] Writing DB stats nova_api:SELECT=6 {{(pid=117199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:47:42.837693 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-e02d31f2-b50a-4445-b4ee-dd33d28b789c admin admin] Calling method '>' {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:47:42.840011 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:47:42.840011 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: warnings.warn(msg) Aug 12 11:47:42.841116 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-e02d31f2-b50a-4445-b4ee-dd33d28b789c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:47:42.841583 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-e02d31f2-b50a-4445-b4ee-dd33d28b789c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:47:42.842001 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-e02d31f2-b50a-4445-b4ee-dd33d28b789c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:47:42.842762 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-e02d31f2-b50a-4445-b4ee-dd33d28b789c admin admin] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:47:42.843201 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-e02d31f2-b50a-4445-b4ee-dd33d28b789c admin admin] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:47:42.843603 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-e02d31f2-b50a-4445-b4ee-dd33d28b789c admin admin] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:47:42.876828 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-e02d31f2-b50a-4445-b4ee-dd33d28b789c admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.194617 Aug 12 11:47:42.877375 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Aug 12 11:47:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 11:47:43.709704 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-a4a4bb66-ec18-470c-ab80-73229213a069 admin admin] Calling method '>' {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:47:43.710753 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-a4a4bb66-ec18-470c-ab80-73229213a069 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 12 11:47:43.711137 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Aug 12 11:47:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:47:43.898250 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-44016efc-74d3-4904-a65e-c7853c488095 admin admin] Calling method '>' {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:47:43.901267 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:47:43.901267 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: warnings.warn(msg) Aug 12 11:47:43.902358 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-44016efc-74d3-4904-a65e-c7853c488095 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:47:43.902851 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-44016efc-74d3-4904-a65e-c7853c488095 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:47:43.903275 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-44016efc-74d3-4904-a65e-c7853c488095 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:47:43.903978 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-44016efc-74d3-4904-a65e-c7853c488095 admin admin] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:47:43.904446 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-44016efc-74d3-4904-a65e-c7853c488095 admin admin] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:47:43.904856 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-44016efc-74d3-4904-a65e-c7853c488095 admin admin] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:47:43.923994 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-44016efc-74d3-4904-a65e-c7853c488095 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076705 Aug 12 11:47:43.924481 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Aug 12 11:47:43 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 11:47:55.145109 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-a4a4bb66-ec18-470c-ab80-73229213a069 admin admin] Calling method '>' {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:47:55.146144 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-a4a4bb66-ec18-470c-ab80-73229213a069 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Aug 12 11:47:55.146535 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Aug 12 11:47:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:47:55.289590 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG dbcounter [-] [117199] Writing DB stats nova_cell0:SELECT=4 {{(pid=117199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:47:55.290829 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG dbcounter [-] [117199] Writing DB stats nova_cell1:SELECT=4 {{(pid=117199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:47:55.291425 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG dbcounter [-] [117199] Writing DB stats nova_api:SELECT=8 {{(pid=117199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:47:55.338868 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-42ca7f3c-cfd0-4844-b2e0-d54571902be4 admin admin] Calling method '>' {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:47:55.341251 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:47:55.341251 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: warnings.warn(msg) Aug 12 11:47:55.342340 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-42ca7f3c-cfd0-4844-b2e0-d54571902be4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:47:55.342839 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-42ca7f3c-cfd0-4844-b2e0-d54571902be4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:47:55.343268 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-42ca7f3c-cfd0-4844-b2e0-d54571902be4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:47:55.343974 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-42ca7f3c-cfd0-4844-b2e0-d54571902be4 admin admin] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:47:55.344418 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-42ca7f3c-cfd0-4844-b2e0-d54571902be4 admin admin] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:47:55.344831 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-42ca7f3c-cfd0-4844-b2e0-d54571902be4 admin admin] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:47:55.369542 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-42ca7f3c-cfd0-4844-b2e0-d54571902be4 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084468 Aug 12 11:47:55.370081 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 38/74] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Aug 12 11:47:55 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:47:56.195371 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: DEBUG nova.api.openstack.wsgi [None req-a4a4bb66-ec18-470c-ab80-73229213a069 admin admin] Calling method '>' {{(pid=117198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:47:56.196991 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: INFO nova.api.openstack.requestlog [None req-a4a4bb66-ec18-470c-ab80-73229213a069 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 12 11:47:56.197388 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: [pid: 117198|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Aug 12 11:47:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:47:56.387043 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG nova.api.openstack.wsgi [None req-acac043a-2e40-439b-a29e-332ca146aee1 admin admin] Calling method '>' {{(pid=117199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:47:56.389404 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:47:56.389404 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: warnings.warn(msg) Aug 12 11:47:56.390484 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-acac043a-2e40-439b-a29e-332ca146aee1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:47:56.390982 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-acac043a-2e40-439b-a29e-332ca146aee1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:47:56.391395 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-acac043a-2e40-439b-a29e-332ca146aee1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:47:56.392146 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-acac043a-2e40-439b-a29e-332ca146aee1 admin admin] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:47:56.392580 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-acac043a-2e40-439b-a29e-332ca146aee1 admin admin] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:47:56.392985 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: DEBUG oslo_concurrency.lockutils [None req-acac043a-2e40-439b-a29e-332ca146aee1 admin admin] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:47:56.414450 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: INFO nova.api.openstack.requestlog [None req-acac043a-2e40-439b-a29e-332ca146aee1 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.077941 Aug 12 11:47:56.415530 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: [pid: 117199|app: 0|req: 39/76] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Aug 12 11:47:56 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:48:53.196901 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: Fri Aug 12 11:48:53 2022 - graceful shutdown triggered... Aug 12 11:48:53.196623 dv-cinder-852828-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 12 11:48:53.197861 dv-cinder-852828-2-iscsi devstack@n-api.service[117199]: Gracefully killing worker 2 (pid: 117199)... Aug 12 11:48:53.198349 dv-cinder-852828-2-iscsi devstack@n-api.service[117198]: Gracefully killing worker 1 (pid: 117198)... Aug 12 11:48:54.197497 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: worker 1 buried after 1 seconds Aug 12 11:48:54.197921 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: worker 2 buried after 1 seconds Aug 12 11:48:54.197921 dv-cinder-852828-2-iscsi devstack@n-api.service[117197]: goodbye to uWSGI. Aug 12 11:48:54.199116 dv-cinder-852828-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 12 11:48:54.199671 dv-cinder-852828-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 12 11:48:54.202512 dv-cinder-852828-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 12 11:48:54.212016 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 12 11:48:54.214547 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 12 11:48:54 2022] *** Aug 12 11:48:54.214754 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 12 11:48:54.214754 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 12 11:48:54.214754 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: nodename: dv-cinder-852828-2-iscsi Aug 12 11:48:54.214754 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: machine: x86_64 Aug 12 11:48:54.214754 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: clock source: unix Aug 12 11:48:54.214754 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: pcre jit disabled Aug 12 11:48:54.214754 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: detected number of CPU cores: 4 Aug 12 11:48:54.214754 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: current working directory: / Aug 12 11:48:54.214754 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: detected binary path: /usr/bin/uwsgi-core Aug 12 11:48:54.214754 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: your processes number limit is 47680 Aug 12 11:48:54.214754 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: your memory page size is 4096 bytes Aug 12 11:48:54.215469 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: detected max file descriptor number: 2048 Aug 12 11:48:54.215469 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: lock engine: pthread robust mutexes Aug 12 11:48:54.215469 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: thunder lock: enabled Aug 12 11:48:54.215469 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 12 11:48:54.215469 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 12 11:48:54.254437 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: Python main interpreter initialized at 0x560b3eeae9c0 Aug 12 11:48:54.254437 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: python threads support enabled Aug 12 11:48:54.254437 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: your server socket listen backlog is limited to 100 connections Aug 12 11:48:54.254437 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: your mercy for graceful operations on workers is 90 seconds Aug 12 11:48:54.254878 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: mapped 403077 bytes (393 KB) for 2 cores Aug 12 11:48:54.255014 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: *** Operational MODE: preforking *** Aug 12 11:48:54.255233 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: *** uWSGI is running in multiple interpreter mode *** Aug 12 11:48:54.255233 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: spawned uWSGI master process (pid: 132270) Aug 12 11:48:54.255424 dv-cinder-852828-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 12 11:48:54.255956 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: spawned uWSGI worker 1 (pid: 132281, cores: 1) Aug 12 11:48:54.256294 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: spawned uWSGI worker 2 (pid: 132282, cores: 1) Aug 12 11:48:54.256465 dv-cinder-852828-2-iscsi devstack@n-api.service[132270]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 12 11:48:54.930164 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 12 11:48:54.954938 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 12 11:48:56.098395 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 11:48:56.098395 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: from cryptography.utils import int_from_bytes Aug 12 11:48:56.099031 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 11:48:56.099031 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: from cryptography.utils import int_from_bytes Aug 12 11:48:56.169591 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 11:48:56.169591 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: from cryptography.utils import int_from_bytes Aug 12 11:48:56.170174 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 11:48:56.170174 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: from cryptography.utils import int_from_bytes Aug 12 11:48:58.438848 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 11:48:58.439387 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 11:48:58.439637 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 11:48:58.440009 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 11:48:58.440271 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 11:48:58.440666 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.441001 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.441332 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.441658 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.441996 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.442312 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.442656 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.442991 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.443344 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.443594 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.443916 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.444250 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852828-2-iscsi {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.444577 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.444890 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.445206 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.445531 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.445841 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.446166 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.447147 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.447657 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.448104 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.448421 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.448740 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.449087 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.449406 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.449725 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.450062 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.450365 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.450719 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.451040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.451447 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852828-2-iscsi {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.451773 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.452093 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.452415 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.452835 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.453157 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.453500 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.453799 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.454129 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.454443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.454808 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.455132 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.455458 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.455784 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.456094 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.456419 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.456723 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.457051 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.457366 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.457794 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.457926 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.458241 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.458775 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.459111 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.459444 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.459702 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.459956 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.460283 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.460609 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.460926 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.461242 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.461557 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.462076 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.462391 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.462731 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.463055 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.463374 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.463702 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.464026 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.464358 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.464672 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.465000 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.465409 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.465667 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.465985 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.466331 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.466675 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.466997 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.467321 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.467651 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.467964 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.468275 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.468589 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.468914 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.469255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.469568 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.469824 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.470133 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.470449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.470798 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.471112 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.471424 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.471739 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.472047 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.472356 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.472671 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.472987 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.473309 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.473618 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.473929 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.474239 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.474551 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.474985 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.475212 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.475539 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.475853 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.476166 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.476478 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.476789 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.477117 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.477435 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.477845 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.478166 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.478481 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.478837 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.479163 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.479480 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.479796 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.480120 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.480439 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.480744 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.481065 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.481380 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.481694 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.482035 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.482315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.482664 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.482962 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.483278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.483592 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.483913 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.484217 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.484544 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.484896 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.485170 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.485482 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.485809 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.486156 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.486495 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.486895 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.487220 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.487558 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.487895 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.488223 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.488541 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.488864 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.489196 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.489516 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.489834 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.490150 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.490478 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.490832 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.491224 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.491486 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.491817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.492253 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.492440 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.492768 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.493107 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.493946 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.494266 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.494709 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.495003 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.495316 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.495649 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.495980 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.496301 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.496620 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.496937 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.497300 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.497604 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.497925 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.498295 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.498567 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.498913 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.499232 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.499552 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.499888 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.500213 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.500537 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.500952 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.501183 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.501508 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.501828 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.502146 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.502474 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.502795 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.503096 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 11:48:58.503567 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.503711 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 11:48:58.503883 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.503883 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.504265 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 11:48:58.504488 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.504658 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 11:48:58.504819 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.504978 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 11:48:58.505208 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.505369 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.505518 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.505667 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.505807 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.505962 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.506103 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.506249 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.506399 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.506558 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.506747 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.506891 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.507042 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.507042 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.507314 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.507575 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.507737 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.507881 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.508028 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.508176 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.508339 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.508552 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.508722 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.508909 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.509585 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852828-2-iscsi {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.509739 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.509880 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.509880 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.510344 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.510492 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.510674 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.510834 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.510976 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.511231 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.511380 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.511380 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.511667 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.511808 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.511955 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.512110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.512260 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.512429 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.512594 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.512821 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.512985 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.513127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.513284 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.513433 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.513574 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.513716 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.513876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.514017 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.514249 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.514405 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.514650 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.514802 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.514971 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.515123 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.515362 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.515525 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.515668 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.515817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.515817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.516099 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852828-2-iscsi {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.516247 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.516388 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.516536 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.516677 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.516817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.516956 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.517102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.517253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.517408 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.517662 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.517819 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.517962 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.518102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.518247 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.518397 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.518397 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.518777 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.518777 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.519077 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.519077 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.519380 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.519531 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.519671 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.519811 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.519959 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.520132 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.520353 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.520508 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.520656 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.520798 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.520945 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.521100 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.521268 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.521497 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.521657 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.521657 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.521935 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.522095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.522237 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.522377 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.522524 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.522725 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.522966 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.523131 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.523281 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.523440 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.523581 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.523731 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.523890 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.524039 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.524197 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.524431 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.524591 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.524834 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.524991 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.525142 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.525297 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.525535 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.525691 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.525842 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.525991 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.526142 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.526285 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.526425 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.526576 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.526743 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.526904 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.527057 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.527198 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.527360 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.527516 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.527770 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.527934 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.528077 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.528226 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.528374 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.528523 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.528700 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.528945 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.529095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.529245 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.529389 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.529548 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.529690 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.529839 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.530034 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.530187 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.530347 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.530559 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.530758 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.531003 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.531155 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.531296 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.531445 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.531683 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.531852 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.532002 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.532143 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.532283 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.532433 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.532582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.532731 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.532872 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.533140 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.533297 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.533438 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.533580 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.533733 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.533884 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.534032 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.534180 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.534321 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.534570 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.534759 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.534992 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.535140 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.535286 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.535442 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.535680 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.535829 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.535990 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.536132 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.536272 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.536420 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.536573 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.536714 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.536855 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.536995 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.537145 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.537294 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.537443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.537591 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.537843 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.538011 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.538154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.538294 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.538444 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.538586 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.538782 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.538951 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.539162 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.539316 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.539470 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.539619 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.539932 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.540126 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.540295 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.540449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.540684 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.540839 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.540983 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.541138 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.541288 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.541440 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.541590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.541838 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.542003 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.542146 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.542294 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.542453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.542595 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.542772 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.542927 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.543078 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.543328 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.543478 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.543626 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.543767 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.543929 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.544080 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.544229 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.544370 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.544551 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.544782 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.544938 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.545169 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.545343 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.546528 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.546755 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.546925 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.547080 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.547080 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.547353 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.547502 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.547673 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.547946 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.548097 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.548250 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.548392 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.548532 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.548671 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.548825 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.548973 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.549122 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.549358 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.549512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.549661 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.549823 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.549972 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.549972 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.550253 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.550404 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.550559 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.550559 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.550930 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.551082 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.551231 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.551231 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.551510 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.551510 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.551789 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.552036 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.552182 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:48:58.552323 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.552478 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.552478 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.552768 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.552920 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.553062 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.553212 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.553353 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.553619 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.553784 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.553934 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.554076 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.554232 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.554374 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.555006 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.555310 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.555506 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.556274 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.556466 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.556646 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.556832 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.557027 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.557223 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.557400 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.557575 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.557751 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.558035 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.558227 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.558412 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.558597 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.558782 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.558927 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.558927 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.559204 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.559373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.559593 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.559739 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.559881 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.560021 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.560169 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.560318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.560466 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.560613 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.561420 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.561595 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.561747 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.561900 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.562068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.562318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.562474 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.562803 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.562963 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.563158 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.563304 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.563453 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.563602 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.563857 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.564007 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.564148 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.564288 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.564441 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.564590 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.564740 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.564891 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.565052 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.565288 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.565512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.565669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.565812 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.565954 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.566103 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.566251 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.566484 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.566685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.566841 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.566983 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.567132 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.567284 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.567433 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.567585 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.567727 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.567867 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.568067 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.568284 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.568431 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.568581 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.568750 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.568750 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.569026 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.569168 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.569322 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.569464 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.569628 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.569851 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.569997 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.570147 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.570298 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.570447 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.570595 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.570795 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.571038 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.571186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.571935 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.572096 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.572247 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.572507 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.572671 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.572827 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.572986 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.573134 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.573280 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.573440 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.573587 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.573748 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.574002 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.574165 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.574314 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.574462 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.574626 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.574793 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.574957 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.575109 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.575282 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.575520 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.575762 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.575930 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.576086 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.576234 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.576234 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.576610 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.576782 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.576941 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.577090 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.577244 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.577398 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.577546 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.577704 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.577870 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.578019 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.578225 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.578473 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.578672 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.578846 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.579004 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.579159 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.579306 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.579453 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.579692 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.579875 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.580098 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.580298 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.580451 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.580599 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.580747 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.580908 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.581145 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.581301 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.581449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.581595 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.581757 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.581915 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.582063 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.582221 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.582369 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.582687 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.582687 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.583199 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.583365 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.583514 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.583661 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.583808 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.583971 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.584234 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.584397 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.584558 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.584718 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.584895 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.585062 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.592505 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.592725 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.592908 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.593070 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.593244 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.593400 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.593558 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.595912 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.596097 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.596272 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.596462 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.596623 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.596777 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.596777 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.597085 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.597235 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.597398 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.597550 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.597707 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.598437 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.598742 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.598986 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.599162 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.599314 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.599472 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.599623 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.599844 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.600846 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.601012 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.601012 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.601340 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.601507 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.601676 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.601828 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.601976 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.602141 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.602290 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.602898 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.603210 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.603391 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.604339 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.604515 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.604676 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.604834 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.605007 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.605166 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.605323 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.605493 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.605643 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.605802 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.606262 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.606430 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.606588 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.607708 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.607708 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.608202 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.608414 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.608594 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.608785 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.608940 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.609104 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.609292 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.609452 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.609602 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.609758 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.609915 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.610084 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.610363 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.610529 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.610750 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.612677 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.612875 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.613122 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.613298 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.613455 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.613617 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.613778 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.613938 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.614098 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.614250 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.614401 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.614557 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.614740 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.614891 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.615065 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.615242 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.615432 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.615582 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.615731 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.615887 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.616044 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.616202 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.616358 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.616508 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.616658 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.616816 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.616966 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.617114 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.617279 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.617429 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.617577 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.617751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.618825 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.619070 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.619256 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.619453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.619608 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.619769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.619920 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.620076 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.620225 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.620392 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.620549 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.620708 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.621298 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.621467 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.621642 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.621801 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.621951 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.623185 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.623354 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.623515 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.623667 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.623818 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.623989 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.624140 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.624140 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.624140 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.624140 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.624795 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.624972 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.625124 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.626133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.626308 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.626469 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.626681 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.626899 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.627084 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.627198 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.627320 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.627433 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.627543 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.627668 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.627668 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.627874 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.629007 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.629170 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.629331 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.629481 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.629630 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.629800 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.629952 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.630108 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.630267 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.630417 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.630573 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.630817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.631009 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.631170 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.631354 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.631590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.631755 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.631917 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.631917 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.632245 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.632808 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.632971 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.633121 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.633270 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.633419 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.634989 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.635154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.635321 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.635484 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.635651 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.635825 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.635990 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.636140 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.636297 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.636455 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.636606 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.636762 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.636923 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.637080 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.637236 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.637567 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.637736 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.637886 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.638056 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.638464 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.638651 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.638819 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.639012 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.639177 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.639327 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.639476 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.639637 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.639787 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.639935 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.640091 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.640336 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.640511 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.640665 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.640822 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.640972 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.641136 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.641293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.641451 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.641617 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.641848 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.642003 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.642166 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.642316 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.642494 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.642494 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.643148 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.643321 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.643321 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.643607 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.643756 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.643910 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.644066 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.644224 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.644380 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.644380 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.644677 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.644845 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.645000 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.645159 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.645316 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.645472 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.645638 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.645789 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.645937 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.646097 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.646254 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.646403 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.646572 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.646793 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.646957 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.647106 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.647262 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.647410 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.647608 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.647771 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.647921 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.648069 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.648217 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.648584 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.648751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.648910 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.649112 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.649266 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.649447 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.649617 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.649766 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.649921 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.650078 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.650227 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.650374 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.650530 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.650701 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.650862 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.651020 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.651180 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.651329 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.651486 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.651643 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.651793 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.652040 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.652206 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.653299 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.653468 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.653619 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.653783 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.653946 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.654102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.654259 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.654416 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.654565 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.654892 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.654892 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.655255 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.655406 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.655569 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.655729 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.655888 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.656038 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.656198 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.656356 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.656511 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.656743 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.656894 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.657041 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.657188 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.657337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.657497 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.657655 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.657811 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.657959 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.657959 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.658261 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.658429 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.658429 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.658429 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.658429 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.659346 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.659497 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.659655 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.659811 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.659960 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.660115 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.660264 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.660426 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.660584 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.660734 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.660882 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.661030 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.661184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.661340 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.661499 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.661649 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.661803 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.661953 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.662206 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.662370 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.662546 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.662723 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.662890 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.663306 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.663306 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.663306 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.663306 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.663306 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.663306 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.663306 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.664538 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.664706 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.664867 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.665016 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.665695 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.665853 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.666016 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.666183 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.666334 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.666733 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.666905 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.667056 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.667214 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.667379 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.667537 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.667706 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.667994 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.668118 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.668118 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.668118 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.668118 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.668552 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.668678 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.669017 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.669244 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.669393 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.669552 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.669665 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.669816 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.669981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.670074 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.670158 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.670239 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.670345 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.670445 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.670588 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.670785 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.670875 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.670959 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.671059 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.671145 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.671228 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.671318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.671417 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.671502 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.671593 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.671685 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.671769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.671851 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.671999 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.672090 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.672200 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.672287 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.672378 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.672462 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.672679 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.672679 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.672857 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.672942 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.673039 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.673039 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.673234 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.673332 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.673425 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.673769 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.673865 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.673865 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.674006 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.674104 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.674189 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.674271 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.674361 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.674444 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.674526 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.674680 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.674770 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.674867 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.674958 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.675043 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.675126 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.675126 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.675288 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.675378 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.675462 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.675545 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.675637 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.675730 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.675821 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.675904 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.676003 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.676089 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.676233 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.676233 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.676396 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.676486 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.676569 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.676711 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.676814 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.676905 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.676990 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.677077 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.677167 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.677251 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.677346 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.677431 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.677520 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.677611 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.677702 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.677793 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.677878 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.677966 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.678057 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.678141 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.678219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.678310 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.678394 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.678476 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.678565 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.678676 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.678769 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.678769 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.678769 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.678769 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.679252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.679389 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.679480 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.679855 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.679957 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.680042 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.680124 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.680214 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.680315 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.680401 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.680483 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.680715 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.680818 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.681390 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.681495 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.681581 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.681664 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.681753 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.681844 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.681935 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.682027 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.682112 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.682194 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.682276 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.682365 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.682449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.682541 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.682790 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.682888 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.682981 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.683065 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.683158 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.683243 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.683327 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.683416 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.683545 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.683660 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.683923 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.684020 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.684113 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.684198 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.684281 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.684372 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.684470 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.684557 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.684640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.684729 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.684823 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.684915 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.685009 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.685100 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.685192 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.685282 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.685372 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.685464 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.685550 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.685685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.685781 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.685872 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.685956 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.686056 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.686056 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.686217 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.686217 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.686377 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.686467 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.686560 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.686678 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.686766 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.686856 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.686981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.687099 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.687224 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.687337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.687447 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.687546 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.687632 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.687776 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.687865 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.687949 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.688041 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.688126 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.688208 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.688303 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.688387 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.688471 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.688471 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.688628 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.688719 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.688812 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.688897 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.688980 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.689069 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.689336 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.689482 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.689584 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.689670 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.689670 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.689825 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.689909 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.690004 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.690095 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.690178 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.690260 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.690341 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.690437 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.690533 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.690647 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.690745 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.690837 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.690921 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.691003 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.691094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.691185 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.691268 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.691358 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.691458 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.691556 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.691648 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.691732 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.691822 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.691895 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.691977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.692068 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.692068 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.692219 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.692302 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.692392 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.692617 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.692715 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.692715 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.692892 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.692985 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.693069 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.693069 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.693240 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.693332 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.693424 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.693509 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.693594 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.693674 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.694076 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.694188 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.694283 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.694375 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.694549 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.694694 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.694811 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.694921 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.695032 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.695145 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.695252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.695418 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.695512 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.695636 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.695746 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.695868 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.695995 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.696119 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.696230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.696379 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.696493 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.696602 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.696721 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.696840 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.696950 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.697059 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.697169 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.697279 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.697401 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.697512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.697621 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.697731 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.697839 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.697948 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.698066 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.698175 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.698292 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.698409 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.698409 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.698591 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.698736 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.698833 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.698924 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.699009 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.699092 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.699183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.699406 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.699547 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.699640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.699731 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.699814 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.699899 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.699977 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.700061 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.700150 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.700240 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.700324 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.700419 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.700511 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.700511 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.700670 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.700753 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.700843 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.700932 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.701014 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.701097 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.701186 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.701270 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.701370 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.701455 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.701544 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.701635 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.701725 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.701809 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.701900 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.701984 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.702073 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.702162 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.702245 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.702327 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.702422 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.702557 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.702663 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.702767 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.702854 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.702933 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.703004 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.703074 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.703150 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.703220 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.703288 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.703364 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.703435 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.703511 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.703581 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.703649 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.703725 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.703807 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.703899 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.703975 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.704303 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.704378 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.704458 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.704458 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.704458 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.704681 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.704760 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.704760 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.704948 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.705023 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.705100 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.705171 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.705254 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.705333 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.705426 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.705569 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.705672 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.705764 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.705848 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.705938 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.706038 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.706122 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.706211 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.706211 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.706211 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.706211 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.706211 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.706571 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.706714 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.706813 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.706899 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.706995 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.707080 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.707169 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.707252 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.707331 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.707421 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.707421 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.707589 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.707672 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.707754 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.707843 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.707935 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.708026 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.708110 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.708110 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.708270 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.708359 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.708451 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.708451 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.708609 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.708680 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.708760 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.708842 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.708933 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.709017 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.709100 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.709183 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.709272 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.709443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.709687 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.709785 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.709870 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.709961 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 11:48:58.710046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.710046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.710046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.710046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.710046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.710046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.710046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.710046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.710632 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.710632 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.710632 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.710632 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.710632 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.710632 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.710632 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.711153 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.711153 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.711300 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.711560 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.711882 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.713918 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.713918 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.713918 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.713918 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.713918 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.713918 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.714875 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.714875 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.714875 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.715199 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.715524 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.715854 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.716444 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.716775 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.717119 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.717455 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.717788 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.718116 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.718448 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.718894 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.719215 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.719532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.719858 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.720177 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.720492 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.720827 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.721147 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.721463 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.721794 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.722115 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.722746 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.723118 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.723451 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.723796 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.724141 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.724478 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.724801 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.725139 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.725460 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.725778 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.726109 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.726431 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.726788 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.727107 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.727432 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.728285 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.728605 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.728929 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.729244 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.729590 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.729910 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.730228 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.730545 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.730904 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.731224 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.731537 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.731857 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.732173 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.732496 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.732812 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.733133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.733446 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.733768 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.734084 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.734405 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.734752 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.735096 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.735410 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.735779 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.736111 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.736434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.736767 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.737092 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.737415 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.737780 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.738112 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.738746 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.739101 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.739433 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.739788 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.740134 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.740488 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.740763 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.741079 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.741419 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.741745 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.742069 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.742392 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.742748 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.743074 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.743987 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.744317 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.744656 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.744981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.745303 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.745623 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.745948 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.746266 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.746586 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.746942 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.747307 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.747643 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.747973 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.748302 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.748631 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.748953 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.749275 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.749596 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.749914 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.750246 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.750588 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.750949 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.751265 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.751710 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.752034 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.752364 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.752697 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.753016 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.753349 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.753680 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.754002 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.754332 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.754688 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.755067 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.755377 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.755716 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.756051 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.756366 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.756680 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.756994 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.757312 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.757640 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.757959 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.758272 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.758582 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.758982 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.759302 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.759614 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.759925 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.760237 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.760557 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.760866 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.761178 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.761490 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.761801 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.762112 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.762422 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.762765 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.763079 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.763393 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.763706 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.764020 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.764328 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.764687 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.765219 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.765355 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.765682 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.766004 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.766339 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.766689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.767021 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.767353 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.767682 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.768000 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.768344 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.768663 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.768984 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.769305 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.769627 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.769944 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.770266 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.770648 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.770967 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.771282 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.771619 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.771947 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.772278 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.772606 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.772926 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.773262 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.773580 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.773901 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.774219 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.774577 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.774935 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.775328 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.775578 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.775898 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.776224 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.776556 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.776896 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.777235 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.777558 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.777897 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.778235 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.778599 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.779002 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.779308 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.779647 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.779976 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.780916 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.780916 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:48:58.780916 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 11:48:58.855541 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO dbcounter [None req-302c9397-68ed-46fd-8414-0f1e76671ec7 None None] Registered counter for database nova_api Aug 12 11:48:58.876884 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_db.sqlalchemy.engines [None req-302c9397-68ed-46fd-8414-0f1e76671ec7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132281) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 11:48:58.883604 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writer thread running {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 11:48:58.930110 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO dbcounter [None req-7b3ae39c-dd6f-41ff-aec0-7dc074e89459 None None] Registered counter for database nova_api Aug 12 11:48:58.941009 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.context [None req-302c9397-68ed-46fd-8414-0f1e76671ec7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b9c220d7-2838-4982-b405-2795c460dd82(cell1) {{(pid=132281) load_cells /opt/stack/nova/nova/context.py:464}} Aug 12 11:48:58.944961 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-302c9397-68ed-46fd-8414-0f1e76671ec7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:48:58.945551 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-302c9397-68ed-46fd-8414-0f1e76671ec7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:48:58.947118 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-302c9397-68ed-46fd-8414-0f1e76671ec7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:48:58.947892 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-302c9397-68ed-46fd-8414-0f1e76671ec7 None None] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:48:58.948354 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-302c9397-68ed-46fd-8414-0f1e76671ec7 None None] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:48:58.950318 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_db.sqlalchemy.engines [None req-7b3ae39c-dd6f-41ff-aec0-7dc074e89459 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132282) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 11:48:58.950457 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-302c9397-68ed-46fd-8414-0f1e76671ec7 None None] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:48:58.952388 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO dbcounter [None req-302c9397-68ed-46fd-8414-0f1e76671ec7 None None] Registered counter for database nova_cell0 Aug 12 11:48:58.956458 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO dbcounter [None req-302c9397-68ed-46fd-8414-0f1e76671ec7 None None] Registered counter for database nova_cell1 Aug 12 11:48:58.956807 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writer thread running {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 11:48:58.963612 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_db.sqlalchemy.engines [None req-302c9397-68ed-46fd-8414-0f1e76671ec7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132281) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 11:48:58.965337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_db.sqlalchemy.engines [None req-302c9397-68ed-46fd-8414-0f1e76671ec7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132281) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 11:48:58.970457 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writer thread running {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 11:48:59.013931 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.context [None req-7b3ae39c-dd6f-41ff-aec0-7dc074e89459 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b9c220d7-2838-4982-b405-2795c460dd82(cell1) {{(pid=132282) load_cells /opt/stack/nova/nova/context.py:464}} Aug 12 11:48:59.017984 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7b3ae39c-dd6f-41ff-aec0-7dc074e89459 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:48:59.018466 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7b3ae39c-dd6f-41ff-aec0-7dc074e89459 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:48:59.020088 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7b3ae39c-dd6f-41ff-aec0-7dc074e89459 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:48:59.020845 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7b3ae39c-dd6f-41ff-aec0-7dc074e89459 None None] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:48:59.021298 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7b3ae39c-dd6f-41ff-aec0-7dc074e89459 None None] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:48:59.023315 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7b3ae39c-dd6f-41ff-aec0-7dc074e89459 None None] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:48:59.025812 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO dbcounter [None req-7b3ae39c-dd6f-41ff-aec0-7dc074e89459 None None] Registered counter for database nova_cell0 Aug 12 11:48:59.029874 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO dbcounter [None req-7b3ae39c-dd6f-41ff-aec0-7dc074e89459 None None] Registered counter for database nova_cell1 Aug 12 11:48:59.036903 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_db.sqlalchemy.engines [None req-7b3ae39c-dd6f-41ff-aec0-7dc074e89459 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132282) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 11:48:59.038716 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_db.sqlalchemy.engines [None req-7b3ae39c-dd6f-41ff-aec0-7dc074e89459 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132282) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 11:48:59.044386 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writer thread running {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 11:48:59.050243 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writer thread running {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 11:48:59.110705 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writer thread running {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 11:48:59.120857 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO dbcounter [None req-302c9397-68ed-46fd-8414-0f1e76671ec7 None None] Registered counter for database nova_cell0 Aug 12 11:48:59.127506 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_db.sqlalchemy.engines [None req-302c9397-68ed-46fd-8414-0f1e76671ec7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132281) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 11:48:59.131987 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writer thread running {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 11:48:59.191875 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO dbcounter [None req-7b3ae39c-dd6f-41ff-aec0-7dc074e89459 None None] Registered counter for database nova_cell0 Aug 12 11:48:59.198732 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_db.sqlalchemy.engines [None req-7b3ae39c-dd6f-41ff-aec0-7dc074e89459 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132282) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 11:48:59.206951 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writer thread running {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 11:48:59.459368 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: WARNING keystonemiddleware.auth_token [None req-302c9397-68ed-46fd-8414-0f1e76671ec7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 11:48:59.467331 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: WARNING keystonemiddleware.auth_token [None req-302c9397-68ed-46fd-8414-0f1e76671ec7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 11:48:59.527494 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: WARNING keystonemiddleware.auth_token [None req-7b3ae39c-dd6f-41ff-aec0-7dc074e89459 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 11:48:59.535299 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: WARNING keystonemiddleware.auth_token [None req-7b3ae39c-dd6f-41ff-aec0-7dc074e89459 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 11:48:59.814091 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: WARNING keystonemiddleware.auth_token [None req-302c9397-68ed-46fd-8414-0f1e76671ec7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 11:48:59.820328 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: WARNING keystonemiddleware.auth_token [None req-302c9397-68ed-46fd-8414-0f1e76671ec7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 11:48:59.827327 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560b3eeae9c0 pid: 132281 (default app) Aug 12 11:48:59.884671 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: WARNING keystonemiddleware.auth_token [None req-7b3ae39c-dd6f-41ff-aec0-7dc074e89459 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 11:48:59.890747 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: WARNING keystonemiddleware.auth_token [None req-7b3ae39c-dd6f-41ff-aec0-7dc074e89459 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 11:48:59.897008 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560b3eeae9c0 pid: 132282 (default app) Aug 12 11:49:34.898872 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_api:SELECT=3 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:34.901440 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell0:SELECT=3 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:34.905028 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=3 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:34.905845 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell0:SELECT=3 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:35.866372 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-64194982-400e-4a75-bb48-d0ae8978cba2 tempest-VolumesGetTestJSON-235599853 tempest-VolumesGetTestJSON-235599853-project] Action: 'create', calling method: .version_select at 0x7f3e5a24ed30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-646514297", "metadata": {"Type": "work"}}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:49:36.988435 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-64194982-400e-4a75-bb48-d0ae8978cba2 tempest-VolumesGetTestJSON-235599853 tempest-VolumesGetTestJSON-235599853-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.123106 Aug 12 11:49:36.989484 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1156 bytes} [Fri Aug 12 11:49:34 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2126 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 12 11:49:37.305509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-f7eb014f-a498-434f-a602-54f9a12da4cc tempest-VolumesGetTestJSON-235599853 tempest-VolumesGetTestJSON-235599853-project] Calling method '.version_select at 0x7f3e5a3068b0>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:49:37.333786 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_api:SELECT=3 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:37.335098 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=3 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:37.336115 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=3 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:37.336970 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=3 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:37.834318 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-f7eb014f-a498-434f-a602-54f9a12da4cc tempest-VolumesGetTestJSON-235599853 tempest-VolumesGetTestJSON-235599853-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7b7ca61a-795c-444b-b21f-034aeec00f82" status: 200 len: 352 microversion: 2.1 time: 0.830717 Aug 12 11:49:37.835290 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 1/2] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Aug 12 11:49:36 2022] GET /compute/v2.1/os-volumes/7b7ca61a-795c-444b-b21f-034aeec00f82 => generated 352 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:49:38.857016 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-f6781f34-031f-4199-8e2b-427213277ef2 tempest-VolumesGetTestJSON-235599853 tempest-VolumesGetTestJSON-235599853-project] Calling method '.version_select at 0x7f3e5a0a7b80>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:49:38.991670 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-f6781f34-031f-4199-8e2b-427213277ef2 tempest-VolumesGetTestJSON-235599853 tempest-VolumesGetTestJSON-235599853-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7b7ca61a-795c-444b-b21f-034aeec00f82" status: 200 len: 353 microversion: 2.1 time: 0.144740 Aug 12 11:49:38.992881 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Aug 12 11:49:38 2022] GET /compute/v2.1/os-volumes/7b7ca61a-795c-444b-b21f-034aeec00f82 => generated 353 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:49:39.006824 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d9c46782-6af2-45f0-9967-5a9a28ddd0b9 tempest-VolumesGetTestJSON-235599853 tempest-VolumesGetTestJSON-235599853-project] Calling method '.version_select at 0x7f3e5a15ab80>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:49:39.130234 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-d9c46782-6af2-45f0-9967-5a9a28ddd0b9 tempest-VolumesGetTestJSON-235599853 tempest-VolumesGetTestJSON-235599853-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7b7ca61a-795c-444b-b21f-034aeec00f82" status: 200 len: 353 microversion: 2.1 time: 0.128479 Aug 12 11:49:39.131423 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Aug 12 11:49:39 2022] GET /compute/v2.1/os-volumes/7b7ca61a-795c-444b-b21f-034aeec00f82 => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:49:39.157319 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-209f8724-16de-4189-9bde-c8e939ef9441 tempest-VolumesGetTestJSON-235599853 tempest-VolumesGetTestJSON-235599853-project] Calling method '.version_select at 0x7f3e5a0be280>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:49:39.346203 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-209f8724-16de-4189-9bde-c8e939ef9441 tempest-VolumesGetTestJSON-235599853 tempest-VolumesGetTestJSON-235599853-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/7b7ca61a-795c-444b-b21f-034aeec00f82" status: 202 len: 0 microversion: 2.1 time: 0.190894 Aug 12 11:49:39.347496 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 3/5] 10.222.0.42 () {58 vars in 1248 bytes} [Fri Aug 12 11:49:39 2022] DELETE /compute/v2.1/os-volumes/7b7ca61a-795c-444b-b21f-034aeec00f82 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:49:39.357507 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-8d0d4373-60df-4054-bbed-d2a05cf5d142 tempest-VolumesGetTestJSON-235599853 tempest-VolumesGetTestJSON-235599853-project] Calling method '.version_select at 0x7f3e5a15ac10>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:49:39.431623 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-8d0d4373-60df-4054-bbed-d2a05cf5d142 tempest-VolumesGetTestJSON-235599853 tempest-VolumesGetTestJSON-235599853-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7b7ca61a-795c-444b-b21f-034aeec00f82" status: 200 len: 352 microversion: 2.1 time: 0.077047 Aug 12 11:49:39.438265 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 3/6] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Aug 12 11:49:39 2022] GET /compute/v2.1/os-volumes/7b7ca61a-795c-444b-b21f-034aeec00f82 => generated 352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:49:40.446791 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-34327d29-8c45-4e98-b9e1-fac58ad6c0e1 tempest-VolumesGetTestJSON-235599853 tempest-VolumesGetTestJSON-235599853-project] Calling method '.version_select at 0x7f3e5a0be940>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:49:40.513184 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.wsgi [None req-34327d29-8c45-4e98-b9e1-fac58ad6c0e1 tempest-VolumesGetTestJSON-235599853 tempest-VolumesGetTestJSON-235599853-project] HTTP exception thrown: Volume 7b7ca61a-795c-444b-b21f-034aeec00f82 could not be found. Aug 12 11:49:40.518125 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-34327d29-8c45-4e98-b9e1-fac58ad6c0e1 tempest-VolumesGetTestJSON-235599853 tempest-VolumesGetTestJSON-235599853-project] Request method failure captured: Aug 12 11:49:40.518125 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: GET /compute/v2.1/os-volumes/7b7ca61a-795c-444b-b21f-034aeec00f82 HTTP/1.1 Aug 12 11:49:40.518125 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 11:49:40.518125 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 11:49:40.518125 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 11:49:40.518125 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 0 Aug 12 11:49:40.518125 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 11:49:40.518125 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 11:49:40.518125 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 11:49:40.518125 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 11:49:40.518125 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9j5OnRHtSylCUK8oUOWLU1XykflGgZd4-ozVqUyaeB9Ed1t-cTSgO6ZyxxztGFd-rRSeQN4aEKPxWJfr0ztqstYea4p2lx2LmpUWatcwG9huZws7W7f6TgiiXWJqiaEdqPRnfdEuww6Fy_b3DXiAvhYTNuuK6jkv9ZzGNQbmktpfFE8 Aug 12 11:49:40.518125 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 11:49:40.518125 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 11:49:40.518125 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 11:49:40.518125 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 11:49:40.518125 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 11:49:40.518125 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 11:49:40.518125 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: d95cca31d0b74726995cc29a83582883 Aug 12 11:49:40.518125 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-VolumesGetTestJSON-235599853 Aug 12 11:49:40.518125 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 11:49:40.518125 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 11:49:40.520384 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d95cca31d0b74726995cc29a83582883", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d95cca31d0b74726995cc29a83582883"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d95cca31d0b74726995cc29a83582883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d95cca31d0b74726995cc29a83582883"}]}] Aug 12 11:49:40.520384 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-VolumesGetTestJSON-235599853 Aug 12 11:49:40.520384 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: d95cca31d0b74726995cc29a83582883 Aug 12 11:49:40.520384 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-VolumesGetTestJSON-235599853 Aug 12 11:49:40.520384 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-VolumesGetTestJSON-235599853-project Aug 12 11:49:40.520384 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 11:49:40.520384 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 11:49:40.520384 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: 57a862085cc6454792ee6eeb7e66db1d Aug 12 11:49:40.520384 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-VolumesGetTestJSON-235599853-project Aug 12 11:49:40.520384 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: Aug 12 11:49:40.520384 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Volume 7b7ca61a-795c-444b-b21f-034aeec00f82 could not be found. Aug 12 11:49:40.520384 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'id': '7b7ca61a-795c-444b-b21f-034aeec00f82'} Aug 12 11:49:40.520384 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:49:40.521255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:49:40.521255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 11:49:40.521255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 11:49:40.521255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 11:49:40.521255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 11:49:40.521255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 11:49:40.521255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 11:49:40.521255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 11:49:40.521255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 11:49:40.521255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 11:49:40.521255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 11:49:40.521255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 11:49:40.521255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 11:49:40.521255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 11:49:40.521255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 11:49:40.521255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7b7ca61a-795c-444b-b21f-034aeec00f82 could not be found. (HTTP 404) (Request-ID: req-758aeee0-ee58-4dbc-9776-cb8ed2b03b30) Aug 12 11:49:40.521255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:49:40.521255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:49:40.521255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:49:40.522150 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:49:40.522150 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 12 11:49:40.522150 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 12 11:49:40.522150 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 11:49:40.522150 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 11:49:40.522150 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 11:49:40.522150 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 11:49:40.522150 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 11:49:40.522150 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 11:49:40.522150 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 11:49:40.522150 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 11:49:40.522150 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 11:49:40.522150 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 11:49:40.522150 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 11:49:40.522150 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 11:49:40.522150 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 11:49:40.522150 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 11:49:40.522150 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 11:49:40.522150 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 11:49:40.523142 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 11:49:40.523142 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 11:49:40.523142 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 11:49:40.523142 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 11:49:40.523142 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7b7ca61a-795c-444b-b21f-034aeec00f82 could not be found. Aug 12 11:49:40.523142 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:49:40.523142 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:49:40.523142 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:49:40.523142 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:49:40.523142 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:49:40.523142 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:49:40.523142 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:49:40.523142 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:49:40.523142 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 11:49:40.523142 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 11:49:40.523142 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:49:40.523142 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:49:40.523142 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 12 11:49:40.523142 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:49:40.524040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7b7ca61a-795c-444b-b21f-034aeec00f82 could not be found. Aug 12 11:49:40.524040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:49:40.524040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:49:40.524040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:49:40.524040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:49:40.524040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:49:40.524040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:49:40.524040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:49:40.524040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:49:40.524040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7b7ca61a-795c-444b-b21f-034aeec00f82 could not be found. Aug 12 11:49:40.524040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:49:40.524040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-34327d29-8c45-4e98-b9e1-fac58ad6c0e1 tempest-VolumesGetTestJSON-235599853 tempest-VolumesGetTestJSON-235599853-project] Returning 404 to user: Volume 7b7ca61a-795c-444b-b21f-034aeec00f82 could not be found. {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:49:40.524040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-34327d29-8c45-4e98-b9e1-fac58ad6c0e1 tempest-VolumesGetTestJSON-235599853 tempest-VolumesGetTestJSON-235599853-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7b7ca61a-795c-444b-b21f-034aeec00f82" status: 404 len: 109 microversion: 2.1 time: 0.079023 Aug 12 11:49:40.524040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Aug 12 11:49:40 2022] GET /compute/v2.1/os-volumes/7b7ca61a-795c-444b-b21f-034aeec00f82 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:49:47.848669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-b9f29a55-6332-40de-954a-89fb57ac7a90 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Action: 'create', calling method: .version_select at 0x7f3e5a0ab280>, body: {"keypair": {"name": "tempest-keypair-1102741577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrvGZu+LOx2TKEgipgDOZ6haf4rknrBlp2RrvjEVinQK0HOR3NXOVHPZTIpL1gyyPI6Z7nTP1QNjYHudp2BDS6Udx52+CeWw11oP8fcSZsEm+E0zhdjZHSHoGyg2t8V1g=="}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:49:47.993017 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-b9f29a55-6332-40de-954a-89fb57ac7a90 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Getting quotas for project 8299891a8d134af4be3f84cdc7abec51. Resources: {'key_pairs'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:49:48.004702 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-b9f29a55-6332-40de-954a-89fb57ac7a90 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Getting quotas for user 72a30400dec14a85889af8d8dd59886e and project 8299891a8d134af4be3f84cdc7abec51. Resources: {'key_pairs'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:49:48.092815 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-b9f29a55-6332-40de-954a-89fb57ac7a90 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.405966 Aug 12 11:49:48.103518 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 4/8] 10.222.0.42 () {60 vars in 1159 bytes} [Fri Aug 12 11:49:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:49:50.124256 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-59bbf236-0011-4800-b433-ac9d0f64c8a3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Action: 'create', calling method: .version_select at 0x7f3e5a024280>, body: {"keypair": {"name": "tempest-keypair-1165031880", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTibpGqtt22vbkfNoRInnv0G2Fn3/pJVapGPaLnXaTNadWsCiad+M4CwLoShg/3tt63C+4gA5rLr0T584kP8heXYuLg683Ae4NrvanynkvwTvQ+cAsMz2W72GpcoY0akg=="}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:49:50.347497 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.quota [None req-59bbf236-0011-4800-b433-ac9d0f64c8a3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Getting quotas for project 34010de730e4448288baf7e944d52cf9. Resources: {'key_pairs'} {{(pid=132281) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:49:50.383818 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.quota [None req-59bbf236-0011-4800-b433-ac9d0f64c8a3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Getting quotas for user 7d02a90e6cb7428985fe399974b385b9 and project 34010de730e4448288baf7e944d52cf9. Resources: {'key_pairs'} {{(pid=132281) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:49:50.525258 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-59bbf236-0011-4800-b433-ac9d0f64c8a3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.534120 Aug 12 11:49:50.526421 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 5/9] 10.222.0.42 () {62 vars in 1200 bytes} [Fri Aug 12 11:49:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 536 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 12 11:49:54.889763 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-7d08d4e1-d589-4719-9f77-4819b2e2a6c9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-863552967", "imageRef": "2887ca5b-6aa2-4cc4-a2be-9322a733fc6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7833e310-6d60-47b5-8e0a-4784db7aa59d"}], "security_groups": [{"name": "tempest-securitygroup--516180449"}], "key_name": "tempest-keypair-1102741577", "user_data": "}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:49:55.405161 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.network.neutron [None req-7d08d4e1-d589-4719-9f77-4819b2e2a6c9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] validate_networks() for [('7833e310-6d60-47b5-8e0a-4784db7aa59d', None, None, None, None, None)] {{(pid=132282) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 11:49:56.766652 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e6aeb848-1dc8-40b1-81c3-848bda3bf0ed tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-978342375", "imageRef": "2887ca5b-6aa2-4cc4-a2be-9322a733fc6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f9c5784f-2937-48fa-ba25-08d09529e1bf"}], "security_groups": [{"name": "tempest-securitygroup--1442967025"}], "key_name": "tempest-keypair-1165031880", "user_data": "}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:49:57.015849 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.network.neutron [None req-e6aeb848-1dc8-40b1-81c3-848bda3bf0ed tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] validate_networks() for [('f9c5784f-2937-48fa-ba25-08d09529e1bf', None, None, None, None, None)] {{(pid=132281) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 11:49:58.019343 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=4 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:58.149895 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-7d08d4e1-d589-4719-9f77-4819b2e2a6c9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Flavor limits 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 11:49:58.150328 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-7d08d4e1-d589-4719-9f77-4819b2e2a6c9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Image limits 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 11:49:58.151093 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-7d08d4e1-d589-4719-9f77-4819b2e2a6c9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Flavor pref 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 11:49:58.152610 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-7d08d4e1-d589-4719-9f77-4819b2e2a6c9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Image pref 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 11:49:58.154065 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-7d08d4e1-d589-4719-9f77-4819b2e2a6c9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 11:49:58.196272 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7d08d4e1-d589-4719-9f77-4819b2e2a6c9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:49:58.199319 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7d08d4e1-d589-4719-9f77-4819b2e2a6c9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:49:58.205549 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7d08d4e1-d589-4719-9f77-4819b2e2a6c9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:49:58.208225 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7d08d4e1-d589-4719-9f77-4819b2e2a6c9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:49:58.209328 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7d08d4e1-d589-4719-9f77-4819b2e2a6c9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:49:58.211484 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7d08d4e1-d589-4719-9f77-4819b2e2a6c9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:49:58.282708 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-7d08d4e1-d589-4719-9f77-4819b2e2a6c9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Getting quotas for project 8299891a8d134af4be3f84cdc7abec51. Resources: {'instances', 'ram', 'cores'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:49:58.306050 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-7d08d4e1-d589-4719-9f77-4819b2e2a6c9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Getting quotas for user 72a30400dec14a85889af8d8dd59886e and project 8299891a8d134af4be3f84cdc7abec51. Resources: {'instances', 'ram', 'cores'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:49:58.334963 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-7d08d4e1-d589-4719-9f77-4819b2e2a6c9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Going to run 1 instances... {{(pid=132282) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 11:49:58.340829 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-7d08d4e1-d589-4719-9f77-4819b2e2a6c9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2887ca5b-6aa2-4cc4-a2be-9322a733fc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132282) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 11:49:58.396453 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-e6aeb848-1dc8-40b1-81c3-848bda3bf0ed tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Flavor limits 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 11:49:58.398941 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-e6aeb848-1dc8-40b1-81c3-848bda3bf0ed tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Image limits 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 11:49:58.399649 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-e6aeb848-1dc8-40b1-81c3-848bda3bf0ed tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Flavor pref 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 11:49:58.400669 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-e6aeb848-1dc8-40b1-81c3-848bda3bf0ed tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Image pref 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 11:49:58.401421 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-e6aeb848-1dc8-40b1-81c3-848bda3bf0ed tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 11:49:58.421353 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e6aeb848-1dc8-40b1-81c3-848bda3bf0ed tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:49:58.423725 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e6aeb848-1dc8-40b1-81c3-848bda3bf0ed tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:49:58.425829 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e6aeb848-1dc8-40b1-81c3-848bda3bf0ed tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:49:58.429185 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e6aeb848-1dc8-40b1-81c3-848bda3bf0ed tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:49:58.431053 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e6aeb848-1dc8-40b1-81c3-848bda3bf0ed tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:49:58.431606 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e6aeb848-1dc8-40b1-81c3-848bda3bf0ed tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:49:58.491196 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.quota [None req-e6aeb848-1dc8-40b1-81c3-848bda3bf0ed tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Getting quotas for project 34010de730e4448288baf7e944d52cf9. Resources: {'instances', 'ram', 'cores'} {{(pid=132281) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:49:58.528458 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-7d08d4e1-d589-4719-9f77-4819b2e2a6c9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.643364 Aug 12 11:49:58.529101 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 5/10] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Aug 12 11:49:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 3645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 11:49:58.531012 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.quota [None req-e6aeb848-1dc8-40b1-81c3-848bda3bf0ed tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Getting quotas for user 7d02a90e6cb7428985fe399974b385b9 and project 34010de730e4448288baf7e944d52cf9. Resources: {'instances', 'ram', 'cores'} {{(pid=132281) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:49:58.573260 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-e6aeb848-1dc8-40b1-81c3-848bda3bf0ed tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Going to run 1 instances... {{(pid=132281) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 11:49:58.581561 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-e6aeb848-1dc8-40b1-81c3-848bda3bf0ed tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2887ca5b-6aa2-4cc4-a2be-9322a733fc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132281) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 11:49:58.805850 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-e6aeb848-1dc8-40b1-81c3-848bda3bf0ed tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.043568 Aug 12 11:49:58.812539 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 6/11] 10.222.0.42 () {62 vars in 1188 bytes} [Fri Aug 12 11:49:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 2045 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 12 11:49:58.988569 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-69f4023b-bafd-45d0-9443-d4b4d9a46d98 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Action: 'create', calling method: .version_select at 0x7f3e597771f0>, body: {"keypair": {"name": "tempest-keypair-1210771350", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFHfb4buos1VeOzPkzuNODjsqBCxWfAjCoaQreB/y3rHQtye4EJgZXSUbn2WilqvS9nzhwkGNapEqXM3RSiPTgRFYLm1Fm+WWIPrpYcJEpOdQR8s0zS7jbeJjxWpxfSGqA=="}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:49:59.062965 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-69f4023b-bafd-45d0-9443-d4b4d9a46d98 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Getting quotas for project ecebdd96e25642468903a1657a8ee82d. Resources: {'key_pairs'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:49:59.080686 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-69f4023b-bafd-45d0-9443-d4b4d9a46d98 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Getting quotas for user 381f8ca947954e01b6255626d4a2888f and project ecebdd96e25642468903a1657a8ee82d. Resources: {'key_pairs'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:49:59.145077 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-69f4023b-bafd-45d0-9443-d4b4d9a46d98 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.614589 Aug 12 11:49:59.146415 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 6/12] 10.222.0.42 () {60 vars in 1159 bytes} [Fri Aug 12 11:49:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:49:59.255217 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-c540e46b-0637-4698-8a26-363d9e461799 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1343903513", "imageRef": "2887ca5b-6aa2-4cc4-a2be-9322a733fc6d", "flavorRef": "452", "networks": [{"uuid": "f2683464-8dc4-4d0c-8ad1-9a6e723aa83e"}]}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:49:59.403428 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.network.neutron [None req-c540e46b-0637-4698-8a26-363d9e461799 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] validate_networks() for [('f2683464-8dc4-4d0c-8ad1-9a6e723aa83e', None, None, None, None, None)] {{(pid=132281) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 11:49:59.676147 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-756fad62-89ce-478a-afa0-e624a60a75d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2014807732", "imageRef": "2887ca5b-6aa2-4cc4-a2be-9322a733fc6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:49:59.837298 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.network.neutron [None req-756fad62-89ce-478a-afa0-e624a60a75d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] validate_networks() for [('8772582a-00cc-4f16-a2d6-b0e982a114ff', None, None, None, None, None)] {{(pid=132282) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 11:50:00.717789 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-c540e46b-0637-4698-8a26-363d9e461799 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Flavor limits 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 11:50:00.718359 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-c540e46b-0637-4698-8a26-363d9e461799 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Image limits 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 11:50:00.718736 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-c540e46b-0637-4698-8a26-363d9e461799 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Flavor pref 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 11:50:00.719277 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-c540e46b-0637-4698-8a26-363d9e461799 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Image pref 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 11:50:00.719701 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-c540e46b-0637-4698-8a26-363d9e461799 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 11:50:00.782841 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c540e46b-0637-4698-8a26-363d9e461799 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:00.782841 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c540e46b-0637-4698-8a26-363d9e461799 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:00.782841 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c540e46b-0637-4698-8a26-363d9e461799 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:00.789017 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c540e46b-0637-4698-8a26-363d9e461799 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:00.791001 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c540e46b-0637-4698-8a26-363d9e461799 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:00.793631 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c540e46b-0637-4698-8a26-363d9e461799 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:00.903818 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.quota [None req-c540e46b-0637-4698-8a26-363d9e461799 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Getting quotas for project 06451ebec8a947829019e1fea6636bc6. Resources: {'instances', 'ram', 'cores'} {{(pid=132281) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:50:00.924755 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.quota [None req-c540e46b-0637-4698-8a26-363d9e461799 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Getting quotas for user 134faab760d04e3ba537619281c316c9 and project 06451ebec8a947829019e1fea6636bc6. Resources: {'instances', 'ram', 'cores'} {{(pid=132281) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:50:01.004281 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-c540e46b-0637-4698-8a26-363d9e461799 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Going to run 1 instances... {{(pid=132281) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 11:50:01.011464 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-c540e46b-0637-4698-8a26-363d9e461799 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2887ca5b-6aa2-4cc4-a2be-9322a733fc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132281) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 11:50:01.177831 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-c540e46b-0637-4698-8a26-363d9e461799 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.368726 Aug 12 11:50:01.186115 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 7/13] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Aug 12 11:49:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 11:50:01.196584 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-3e2f419e-4f5e-4fa0-ac37-eb763d70186b tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:01.202018 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-3e2f419e-4f5e-4fa0-ac37-eb763d70186b tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:01.891328 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-756fad62-89ce-478a-afa0-e624a60a75d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Flavor limits 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 11:50:01.891328 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-756fad62-89ce-478a-afa0-e624a60a75d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Image limits 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 11:50:01.891772 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-756fad62-89ce-478a-afa0-e624a60a75d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Flavor pref 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 11:50:01.892178 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-756fad62-89ce-478a-afa0-e624a60a75d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Image pref 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 11:50:01.892598 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-756fad62-89ce-478a-afa0-e624a60a75d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 11:50:01.897344 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-3e2f419e-4f5e-4fa0-ac37-eb763d70186b tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:01.909323 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-756fad62-89ce-478a-afa0-e624a60a75d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:01.910122 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-756fad62-89ce-478a-afa0-e624a60a75d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:01.911128 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-756fad62-89ce-478a-afa0-e624a60a75d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:01.912124 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-756fad62-89ce-478a-afa0-e624a60a75d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:01.912797 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-756fad62-89ce-478a-afa0-e624a60a75d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:01.913482 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-756fad62-89ce-478a-afa0-e624a60a75d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:01.929869 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-3e2f419e-4f5e-4fa0-ac37-eb763d70186b tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1241 microversion: 2.1 time: 0.741392 Aug 12 11:50:01.931714 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 8/14] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:01 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1241 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:01.954903 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-3a04c729-ba6c-493f-8a3c-ac5114b16324 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:01.956108 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-3a04c729-ba6c-493f-8a3c-ac5114b16324 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:01.973301 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-756fad62-89ce-478a-afa0-e624a60a75d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Getting quotas for project a7e2fce9e9db463aa70188453f20d110. Resources: {'instances', 'ram', 'cores'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:50:01.982855 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-756fad62-89ce-478a-afa0-e624a60a75d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Getting quotas for user 64ec7445644e478ca961be80f84f9863 and project a7e2fce9e9db463aa70188453f20d110. Resources: {'instances', 'ram', 'cores'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:50:02.032716 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-756fad62-89ce-478a-afa0-e624a60a75d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Going to run 1 instances... {{(pid=132282) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 11:50:02.035459 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-756fad62-89ce-478a-afa0-e624a60a75d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2887ca5b-6aa2-4cc4-a2be-9322a733fc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132282) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 11:50:02.151633 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-756fad62-89ce-478a-afa0-e624a60a75d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.003970 Aug 12 11:50:02.159491 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 7/15] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Aug 12 11:49:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 3013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 11:50:02.176209 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-c001d958-4174-4e74-b021-df787e14dbb2 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:02.177065 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-c001d958-4174-4e74-b021-df787e14dbb2 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:02.215316 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c001d958-4174-4e74-b021-df787e14dbb2 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:02.215916 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c001d958-4174-4e74-b021-df787e14dbb2 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:02.216492 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c001d958-4174-4e74-b021-df787e14dbb2 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:02.217214 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c001d958-4174-4e74-b021-df787e14dbb2 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:02.217679 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c001d958-4174-4e74-b021-df787e14dbb2 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:02.218108 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c001d958-4174-4e74-b021-df787e14dbb2 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:02.620533 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-3a04c729-ba6c-493f-8a3c-ac5114b16324 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:02.632437 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-3a04c729-ba6c-493f-8a3c-ac5114b16324 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:02.641138 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-3a04c729-ba6c-493f-8a3c-ac5114b16324 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:02.642425 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-3a04c729-ba6c-493f-8a3c-ac5114b16324 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1281 microversion: 2.20 time: 0.693418 Aug 12 11:50:02.644827 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 9/16] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:01 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1281 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:02.664211 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-8d2933a5-0593-46f1-a421-223495c0d45a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:02.665072 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-8d2933a5-0593-46f1-a421-223495c0d45a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:02.685699 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-c001d958-4174-4e74-b021-df787e14dbb2 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:02.717231 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-c001d958-4174-4e74-b021-df787e14dbb2 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1219 microversion: 2.1 time: 0.555826 Aug 12 11:50:02.724914 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 8/17] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:02 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1219 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:02.917835 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-8d2933a5-0593-46f1-a421-223495c0d45a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:02.956062 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-c0a23125-9786-4223-8cd2-b8ea765aa2de tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:02.958244 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-8d2933a5-0593-46f1-a421-223495c0d45a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1222 microversion: 2.1 time: 0.307333 Aug 12 11:50:02.959762 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-c0a23125-9786-4223-8cd2-b8ea765aa2de tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:02.967407 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 10/18] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:02 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1222 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:02.976935 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c0a23125-9786-4223-8cd2-b8ea765aa2de tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:02.977749 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c0a23125-9786-4223-8cd2-b8ea765aa2de tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:02.979576 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c0a23125-9786-4223-8cd2-b8ea765aa2de tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:02.980677 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c0a23125-9786-4223-8cd2-b8ea765aa2de tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:02.981519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c0a23125-9786-4223-8cd2-b8ea765aa2de tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:02.983320 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c0a23125-9786-4223-8cd2-b8ea765aa2de tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:03.099566 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-1f108c78-fba5-4dec-9c0b-24ba91756b8e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-666552170", "imageRef": "2887ca5b-6aa2-4cc4-a2be-9322a733fc6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a325c0ef-f3fe-4738-9917-23a20123f384"}], "security_groups": [{"name": "tempest-securitygroup--1717837920"}], "key_name": "tempest-keypair-1210771350", "user_data": "}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:50:03.220048 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-c0a23125-9786-4223-8cd2-b8ea765aa2de tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:03.228154 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-c0a23125-9786-4223-8cd2-b8ea765aa2de tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1301 microversion: 2.1 time: 0.276693 Aug 12 11:50:03.229886 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 9/19] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:02 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1301 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:03.251947 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-5fee0a55-e9ab-44b7-84e0-440d904ca8c0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-112965622", "imageRef": "2887ca5b-6aa2-4cc4-a2be-9322a733fc6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:50:03.471641 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.network.neutron [None req-5fee0a55-e9ab-44b7-84e0-440d904ca8c0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] validate_networks() for [('8772582a-00cc-4f16-a2d6-b0e982a114ff', None, None, None, None, None)] {{(pid=132282) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 11:50:03.499771 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.network.neutron [None req-1f108c78-fba5-4dec-9c0b-24ba91756b8e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] validate_networks() for [('a325c0ef-f3fe-4738-9917-23a20123f384', None, None, None, None, None)] {{(pid=132281) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 11:50:05.902052 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-1f108c78-fba5-4dec-9c0b-24ba91756b8e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Flavor limits 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 11:50:05.902686 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-1f108c78-fba5-4dec-9c0b-24ba91756b8e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Image limits 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 11:50:05.902991 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-1f108c78-fba5-4dec-9c0b-24ba91756b8e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Flavor pref 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 11:50:05.903422 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-1f108c78-fba5-4dec-9c0b-24ba91756b8e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Image pref 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 11:50:05.904229 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-1f108c78-fba5-4dec-9c0b-24ba91756b8e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 11:50:05.949894 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1f108c78-fba5-4dec-9c0b-24ba91756b8e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:05.950424 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1f108c78-fba5-4dec-9c0b-24ba91756b8e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:05.950962 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1f108c78-fba5-4dec-9c0b-24ba91756b8e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:05.951771 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1f108c78-fba5-4dec-9c0b-24ba91756b8e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:05.952230 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1f108c78-fba5-4dec-9c0b-24ba91756b8e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:05.952650 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1f108c78-fba5-4dec-9c0b-24ba91756b8e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:05.960899 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-5fee0a55-e9ab-44b7-84e0-440d904ca8c0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Flavor limits 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 11:50:05.961857 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-5fee0a55-e9ab-44b7-84e0-440d904ca8c0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Image limits 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 11:50:05.962482 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-5fee0a55-e9ab-44b7-84e0-440d904ca8c0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Flavor pref 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 11:50:05.963989 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-5fee0a55-e9ab-44b7-84e0-440d904ca8c0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Image pref 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 11:50:05.964562 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-5fee0a55-e9ab-44b7-84e0-440d904ca8c0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 11:50:05.982992 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5fee0a55-e9ab-44b7-84e0-440d904ca8c0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:05.983486 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5fee0a55-e9ab-44b7-84e0-440d904ca8c0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:05.983930 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5fee0a55-e9ab-44b7-84e0-440d904ca8c0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:05.984669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5fee0a55-e9ab-44b7-84e0-440d904ca8c0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:05.985571 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5fee0a55-e9ab-44b7-84e0-440d904ca8c0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:05.985571 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5fee0a55-e9ab-44b7-84e0-440d904ca8c0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:06.039290 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.quota [None req-1f108c78-fba5-4dec-9c0b-24ba91756b8e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Getting quotas for project ecebdd96e25642468903a1657a8ee82d. Resources: {'instances', 'ram', 'cores'} {{(pid=132281) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:50:06.059203 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-5fee0a55-e9ab-44b7-84e0-440d904ca8c0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Getting quotas for project a7e2fce9e9db463aa70188453f20d110. Resources: {'instances', 'ram', 'cores'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:50:06.069923 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.quota [None req-1f108c78-fba5-4dec-9c0b-24ba91756b8e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Getting quotas for user 381f8ca947954e01b6255626d4a2888f and project ecebdd96e25642468903a1657a8ee82d. Resources: {'instances', 'ram', 'cores'} {{(pid=132281) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:50:06.082461 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-5fee0a55-e9ab-44b7-84e0-440d904ca8c0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Getting quotas for user 64ec7445644e478ca961be80f84f9863 and project a7e2fce9e9db463aa70188453f20d110. Resources: {'instances', 'ram', 'cores'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:50:06.114331 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-1f108c78-fba5-4dec-9c0b-24ba91756b8e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Going to run 1 instances... {{(pid=132281) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 11:50:06.117217 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-1f108c78-fba5-4dec-9c0b-24ba91756b8e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2887ca5b-6aa2-4cc4-a2be-9322a733fc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132281) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 11:50:06.120259 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-5fee0a55-e9ab-44b7-84e0-440d904ca8c0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Going to run 1 instances... {{(pid=132282) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 11:50:06.125950 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-5fee0a55-e9ab-44b7-84e0-440d904ca8c0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2887ca5b-6aa2-4cc4-a2be-9322a733fc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132282) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 11:50:06.229101 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-1f108c78-fba5-4dec-9c0b-24ba91756b8e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.136987 Aug 12 11:50:06.229507 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Aug 12 11:50:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 3139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 12 11:50:06.240180 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-5ca006d2-c02f-473b-afc9-820f1d14ebc3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:06.240722 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-5ca006d2-c02f-473b-afc9-820f1d14ebc3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:06.282857 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5ca006d2-c02f-473b-afc9-820f1d14ebc3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:06.283846 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5ca006d2-c02f-473b-afc9-820f1d14ebc3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:06.286316 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5ca006d2-c02f-473b-afc9-820f1d14ebc3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:06.290001 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5ca006d2-c02f-473b-afc9-820f1d14ebc3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:06.292462 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5ca006d2-c02f-473b-afc9-820f1d14ebc3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:06.294985 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5ca006d2-c02f-473b-afc9-820f1d14ebc3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:06.329898 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-5fee0a55-e9ab-44b7-84e0-440d904ca8c0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.085464 Aug 12 11:50:06.332807 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 10/21] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Aug 12 11:50:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 3089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 12 11:50:06.355089 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-86759ce3-8020-46e3-831c-85c3d9e0d34f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:06.356530 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-86759ce3-8020-46e3-831c-85c3d9e0d34f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:06.386153 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-86759ce3-8020-46e3-831c-85c3d9e0d34f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:06.391344 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-86759ce3-8020-46e3-831c-85c3d9e0d34f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:06.398985 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-86759ce3-8020-46e3-831c-85c3d9e0d34f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:06.399860 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-86759ce3-8020-46e3-831c-85c3d9e0d34f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:06.400360 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-86759ce3-8020-46e3-831c-85c3d9e0d34f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:06.400811 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-86759ce3-8020-46e3-831c-85c3d9e0d34f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:06.805100 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-86759ce3-8020-46e3-831c-85c3d9e0d34f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:06.822461 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-86759ce3-8020-46e3-831c-85c3d9e0d34f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1273 microversion: 2.1 time: 0.482733 Aug 12 11:50:06.827525 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 11/22] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:06 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1273 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:06.848321 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-02c4ff20-9528-4f89-b1c0-ce217378c225 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:06.850891 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-02c4ff20-9528-4f89-b1c0-ce217378c225 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:06.864013 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-02c4ff20-9528-4f89-b1c0-ce217378c225 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:06.868985 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-02c4ff20-9528-4f89-b1c0-ce217378c225 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:06.870219 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-02c4ff20-9528-4f89-b1c0-ce217378c225 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:06.871198 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-02c4ff20-9528-4f89-b1c0-ce217378c225 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:06.872920 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-02c4ff20-9528-4f89-b1c0-ce217378c225 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:06.877385 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-02c4ff20-9528-4f89-b1c0-ce217378c225 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:07.082319 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-5ca006d2-c02f-473b-afc9-820f1d14ebc3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:07.124454 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-5ca006d2-c02f-473b-afc9-820f1d14ebc3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:07.126894 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-5ca006d2-c02f-473b-afc9-820f1d14ebc3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:07.128690 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-5ca006d2-c02f-473b-afc9-820f1d14ebc3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1339 microversion: 2.20 time: 0.898193 Aug 12 11:50:07.129532 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 12/23] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:06 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1339 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:07.155129 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-538293a8-c102-47a4-a222-b89936609c77 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:07.156431 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-538293a8-c102-47a4-a222-b89936609c77 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:07.396555 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-538293a8-c102-47a4-a222-b89936609c77 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:07.406421 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-538293a8-c102-47a4-a222-b89936609c77 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1237 microversion: 2.1 time: 0.259246 Aug 12 11:50:07.423034 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 13/24] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:07 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1237 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:07.432259 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-4aa5945a-8e26-4d67-a997-b70e06ba059b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:07.435938 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-4aa5945a-8e26-4d67-a997-b70e06ba059b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:07.443564 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4aa5945a-8e26-4d67-a997-b70e06ba059b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:07.444312 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4aa5945a-8e26-4d67-a997-b70e06ba059b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:07.445112 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4aa5945a-8e26-4d67-a997-b70e06ba059b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:07.446426 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4aa5945a-8e26-4d67-a997-b70e06ba059b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:07.447108 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4aa5945a-8e26-4d67-a997-b70e06ba059b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:07.447827 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4aa5945a-8e26-4d67-a997-b70e06ba059b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:07.743887 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-4aa5945a-8e26-4d67-a997-b70e06ba059b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:07.756576 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-4aa5945a-8e26-4d67-a997-b70e06ba059b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1225 microversion: 2.1 time: 0.329539 Aug 12 11:50:07.759553 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 14/25] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:07 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1225 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:07.760247 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-02c4ff20-9528-4f89-b1c0-ce217378c225 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:07.768242 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-02c4ff20-9528-4f89-b1c0-ce217378c225 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1366 microversion: 2.1 time: 0.939445 Aug 12 11:50:07.784737 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 12/26] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:06 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1366 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:07.851573 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-586d45c9-7e05-4f00-8491-8304a6a366fd tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:07.854028 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-586d45c9-7e05-4f00-8491-8304a6a366fd tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:07.874883 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-586d45c9-7e05-4f00-8491-8304a6a366fd tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:07.875665 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-586d45c9-7e05-4f00-8491-8304a6a366fd tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:07.881039 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-586d45c9-7e05-4f00-8491-8304a6a366fd tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:07.884582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-586d45c9-7e05-4f00-8491-8304a6a366fd tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:07.887385 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-586d45c9-7e05-4f00-8491-8304a6a366fd tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:07.888273 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-586d45c9-7e05-4f00-8491-8304a6a366fd tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:07.980130 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-586d45c9-7e05-4f00-8491-8304a6a366fd tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:07.997452 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-586d45c9-7e05-4f00-8491-8304a6a366fd tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1273 microversion: 2.1 time: 0.151219 Aug 12 11:50:08.001084 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 15/27] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:07 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1273 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:08.154380 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-c27f88bd-cdb6-4b28-b56c-e61a94c0ba9f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:08.155546 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-c27f88bd-cdb6-4b28-b56c-e61a94c0ba9f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:08.166561 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c27f88bd-cdb6-4b28-b56c-e61a94c0ba9f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:08.169360 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c27f88bd-cdb6-4b28-b56c-e61a94c0ba9f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:08.170701 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c27f88bd-cdb6-4b28-b56c-e61a94c0ba9f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:08.172740 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c27f88bd-cdb6-4b28-b56c-e61a94c0ba9f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:08.173379 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c27f88bd-cdb6-4b28-b56c-e61a94c0ba9f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:08.175320 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c27f88bd-cdb6-4b28-b56c-e61a94c0ba9f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:08.429367 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-9d40edf8-0a9c-479c-a996-9efa52214707 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:08.429992 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-9d40edf8-0a9c-479c-a996-9efa52214707 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:08.444117 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9d40edf8-0a9c-479c-a996-9efa52214707 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:08.444656 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9d40edf8-0a9c-479c-a996-9efa52214707 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:08.445100 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9d40edf8-0a9c-479c-a996-9efa52214707 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:08.451433 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9d40edf8-0a9c-479c-a996-9efa52214707 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:08.452076 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9d40edf8-0a9c-479c-a996-9efa52214707 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:08.452529 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9d40edf8-0a9c-479c-a996-9efa52214707 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:08.726867 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-c27f88bd-cdb6-4b28-b56c-e61a94c0ba9f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:08.737967 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-c27f88bd-cdb6-4b28-b56c-e61a94c0ba9f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:08.764672 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-c27f88bd-cdb6-4b28-b56c-e61a94c0ba9f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:08.766589 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-c27f88bd-cdb6-4b28-b56c-e61a94c0ba9f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1339 microversion: 2.20 time: 0.617141 Aug 12 11:50:08.767504 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 13/28] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:08 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1339 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:08.780232 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d686d969-cce3-444d-bff9-5bd5aaa7a883 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:08.781132 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d686d969-cce3-444d-bff9-5bd5aaa7a883 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:08.799981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d686d969-cce3-444d-bff9-5bd5aaa7a883 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:08.805068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d686d969-cce3-444d-bff9-5bd5aaa7a883 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:08.807622 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d686d969-cce3-444d-bff9-5bd5aaa7a883 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:08.813603 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d686d969-cce3-444d-bff9-5bd5aaa7a883 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:08.816253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d686d969-cce3-444d-bff9-5bd5aaa7a883 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:08.820618 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d686d969-cce3-444d-bff9-5bd5aaa7a883 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:08.902530 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-9d40edf8-0a9c-479c-a996-9efa52214707 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:08.925288 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-9d40edf8-0a9c-479c-a996-9efa52214707 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1241 microversion: 2.1 time: 0.498341 Aug 12 11:50:08.929412 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 16/29] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:08 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1241 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:08.943256 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-a4cfde22-2592-45c1-92ea-423e5380e264 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:08.945087 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-a4cfde22-2592-45c1-92ea-423e5380e264 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:08.958464 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a4cfde22-2592-45c1-92ea-423e5380e264 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:08.959643 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a4cfde22-2592-45c1-92ea-423e5380e264 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:08.960455 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a4cfde22-2592-45c1-92ea-423e5380e264 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:08.961530 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a4cfde22-2592-45c1-92ea-423e5380e264 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:08.962150 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a4cfde22-2592-45c1-92ea-423e5380e264 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:08.980220 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a4cfde22-2592-45c1-92ea-423e5380e264 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:09.257700 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d686d969-cce3-444d-bff9-5bd5aaa7a883 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:09.266638 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-d686d969-cce3-444d-bff9-5bd5aaa7a883 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1217 microversion: 2.1 time: 0.490902 Aug 12 11:50:09.269338 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 14/30] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:08 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1217 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:09.286844 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-29594882-0a85-4f7c-a9e1-c84ddc42a267 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:09.290386 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-29594882-0a85-4f7c-a9e1-c84ddc42a267 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:09.314133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-29594882-0a85-4f7c-a9e1-c84ddc42a267 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:09.330910 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-29594882-0a85-4f7c-a9e1-c84ddc42a267 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:09.331797 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-29594882-0a85-4f7c-a9e1-c84ddc42a267 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:09.336760 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-29594882-0a85-4f7c-a9e1-c84ddc42a267 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:09.343375 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-29594882-0a85-4f7c-a9e1-c84ddc42a267 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:09.347161 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-29594882-0a85-4f7c-a9e1-c84ddc42a267 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:10.479349 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-a4cfde22-2592-45c1-92ea-423e5380e264 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:10.499063 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-a4cfde22-2592-45c1-92ea-423e5380e264 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1366 microversion: 2.1 time: 1.561007 Aug 12 11:50:10.515961 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 17/31] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:08 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1366 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:10.529456 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-bbf4aefe-50a8-4393-a9d7-0276bd63cf14 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:10.531738 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-bbf4aefe-50a8-4393-a9d7-0276bd63cf14 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:10.546105 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bbf4aefe-50a8-4393-a9d7-0276bd63cf14 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:10.549190 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bbf4aefe-50a8-4393-a9d7-0276bd63cf14 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:10.549800 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bbf4aefe-50a8-4393-a9d7-0276bd63cf14 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:10.552582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bbf4aefe-50a8-4393-a9d7-0276bd63cf14 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:10.555468 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bbf4aefe-50a8-4393-a9d7-0276bd63cf14 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:10.556123 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bbf4aefe-50a8-4393-a9d7-0276bd63cf14 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:10.826515 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-29594882-0a85-4f7c-a9e1-c84ddc42a267 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:10.856131 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-29594882-0a85-4f7c-a9e1-c84ddc42a267 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 1.574283 Aug 12 11:50:10.860666 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 15/32] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:09 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:10.877043 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-36a3648f-e06a-4199-a536-c1113e357000 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:10.879227 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-36a3648f-e06a-4199-a536-c1113e357000 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:10.927465 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-36a3648f-e06a-4199-a536-c1113e357000 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:10.929360 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-36a3648f-e06a-4199-a536-c1113e357000 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:10.935419 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-36a3648f-e06a-4199-a536-c1113e357000 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:10.945335 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-36a3648f-e06a-4199-a536-c1113e357000 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:10.946193 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-36a3648f-e06a-4199-a536-c1113e357000 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:10.948202 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-36a3648f-e06a-4199-a536-c1113e357000 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:11.872930 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-bbf4aefe-50a8-4393-a9d7-0276bd63cf14 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:11.903856 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-bbf4aefe-50a8-4393-a9d7-0276bd63cf14 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:11.905776 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-bbf4aefe-50a8-4393-a9d7-0276bd63cf14 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:11.925729 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-bbf4aefe-50a8-4393-a9d7-0276bd63cf14 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1339 microversion: 2.20 time: 1.407535 Aug 12 11:50:11.937127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 18/33] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:10 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1339 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:11.947240 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-4f29d742-e1fc-4a63-a854-6d56fa006ccc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:11.956688 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-4f29d742-e1fc-4a63-a854-6d56fa006ccc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:11.985006 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4f29d742-e1fc-4a63-a854-6d56fa006ccc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:11.998899 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4f29d742-e1fc-4a63-a854-6d56fa006ccc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:12.007709 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4f29d742-e1fc-4a63-a854-6d56fa006ccc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:12.008605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4f29d742-e1fc-4a63-a854-6d56fa006ccc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:12.009809 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4f29d742-e1fc-4a63-a854-6d56fa006ccc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:12.016105 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4f29d742-e1fc-4a63-a854-6d56fa006ccc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:12.261158 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-36a3648f-e06a-4199-a536-c1113e357000 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:12.272002 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-36a3648f-e06a-4199-a536-c1113e357000 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1307 microversion: 2.1 time: 1.409937 Aug 12 11:50:12.277959 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 16/34] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:10 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1307 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:12.291756 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-ea31a74b-f954-4706-bafd-748dd80243f3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:12.303610 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-ea31a74b-f954-4706-bafd-748dd80243f3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:12.314305 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ea31a74b-f954-4706-bafd-748dd80243f3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:12.319014 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ea31a74b-f954-4706-bafd-748dd80243f3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:12.323357 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ea31a74b-f954-4706-bafd-748dd80243f3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:12.325468 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ea31a74b-f954-4706-bafd-748dd80243f3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:12.334744 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ea31a74b-f954-4706-bafd-748dd80243f3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:12.336252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ea31a74b-f954-4706-bafd-748dd80243f3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:12.571892 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-4f29d742-e1fc-4a63-a854-6d56fa006ccc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:12.581504 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-4f29d742-e1fc-4a63-a854-6d56fa006ccc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1279 microversion: 2.1 time: 0.642909 Aug 12 11:50:12.595517 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 19/35] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:11 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1279 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:12.609624 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-d24d80bf-820a-4452-b364-e7febedd5333 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:12.610578 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-d24d80bf-820a-4452-b364-e7febedd5333 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:12.619109 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d24d80bf-820a-4452-b364-e7febedd5333 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:12.620828 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d24d80bf-820a-4452-b364-e7febedd5333 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:12.621510 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d24d80bf-820a-4452-b364-e7febedd5333 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:12.622733 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d24d80bf-820a-4452-b364-e7febedd5333 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:12.623429 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d24d80bf-820a-4452-b364-e7febedd5333 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:12.624069 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d24d80bf-820a-4452-b364-e7febedd5333 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:14.815194 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-d24d80bf-820a-4452-b364-e7febedd5333 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:14.829168 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-d24d80bf-820a-4452-b364-e7febedd5333 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 2.228416 Aug 12 11:50:14.830186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 20/36] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:12 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 2234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:14.847902 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-81d16214-b42d-423b-8da7-e7bb556f73cd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:14.848897 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-81d16214-b42d-423b-8da7-e7bb556f73cd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:14.855367 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-81d16214-b42d-423b-8da7-e7bb556f73cd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:14.860159 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-81d16214-b42d-423b-8da7-e7bb556f73cd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:14.860953 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-81d16214-b42d-423b-8da7-e7bb556f73cd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:14.862010 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-81d16214-b42d-423b-8da7-e7bb556f73cd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:14.862707 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-81d16214-b42d-423b-8da7-e7bb556f73cd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:14.863345 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-81d16214-b42d-423b-8da7-e7bb556f73cd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:15.244194 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-ea31a74b-f954-4706-bafd-748dd80243f3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:15.251687 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-ea31a74b-f954-4706-bafd-748dd80243f3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1366 microversion: 2.1 time: 2.972285 Aug 12 11:50:15.260830 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 17/37] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:12 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1366 bytes in 2981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:15.267182 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-092e7f20-24dd-44c0-9ae9-cf1d81945537 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:15.267759 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-092e7f20-24dd-44c0-9ae9-cf1d81945537 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:15.290719 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-092e7f20-24dd-44c0-9ae9-cf1d81945537 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:15.291224 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-092e7f20-24dd-44c0-9ae9-cf1d81945537 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:15.291671 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-092e7f20-24dd-44c0-9ae9-cf1d81945537 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:15.292379 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-092e7f20-24dd-44c0-9ae9-cf1d81945537 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:15.292836 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-092e7f20-24dd-44c0-9ae9-cf1d81945537 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:15.293266 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-092e7f20-24dd-44c0-9ae9-cf1d81945537 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:15.984796 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell0:SELECT=6 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:16.004455 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=6 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:16.035453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-092e7f20-24dd-44c0-9ae9-cf1d81945537 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:16.044578 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-092e7f20-24dd-44c0-9ae9-cf1d81945537 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1295 microversion: 2.1 time: 0.782573 Aug 12 11:50:16.049209 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 18/38] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:15 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1295 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:16.112734 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=22 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:16.117412 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-81d16214-b42d-423b-8da7-e7bb556f73cd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:16.139208 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-81d16214-b42d-423b-8da7-e7bb556f73cd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:16.145021 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-81d16214-b42d-423b-8da7-e7bb556f73cd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:16.149503 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-81d16214-b42d-423b-8da7-e7bb556f73cd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 1.315950 Aug 12 11:50:16.151478 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 21/39] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:14 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:16.163133 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-1b0246b8-8675-40ee-a9a9-84a365ec75fe tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:16.164124 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-1b0246b8-8675-40ee-a9a9-84a365ec75fe tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:16.176648 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:16.180852 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1b0246b8-8675-40ee-a9a9-84a365ec75fe tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:16.182000 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1b0246b8-8675-40ee-a9a9-84a365ec75fe tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:16.183858 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1b0246b8-8675-40ee-a9a9-84a365ec75fe tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:16.186802 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1b0246b8-8675-40ee-a9a9-84a365ec75fe tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:16.187548 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1b0246b8-8675-40ee-a9a9-84a365ec75fe tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:16.188193 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1b0246b8-8675-40ee-a9a9-84a365ec75fe tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:16.415169 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-1b0246b8-8675-40ee-a9a9-84a365ec75fe tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:16.429945 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-1b0246b8-8675-40ee-a9a9-84a365ec75fe tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1279 microversion: 2.1 time: 0.277004 Aug 12 11:50:16.430854 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 22/40] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:16 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1279 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:16.451454 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-0981590f-876f-474a-ab96-aa9b01c6a600 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:16.452277 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-0981590f-876f-474a-ab96-aa9b01c6a600 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:16.464321 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0981590f-876f-474a-ab96-aa9b01c6a600 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:16.466590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0981590f-876f-474a-ab96-aa9b01c6a600 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:16.467284 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0981590f-876f-474a-ab96-aa9b01c6a600 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:16.468756 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0981590f-876f-474a-ab96-aa9b01c6a600 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:16.471289 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0981590f-876f-474a-ab96-aa9b01c6a600 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:16.471977 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0981590f-876f-474a-ab96-aa9b01c6a600 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:16.533685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-b7df7e97-ecd4-4e19-8001-b296b02a22d1 req-f93ba6df-a5a6-43bd-b1f4-1a6ee285e72e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4ed98fc-5acc-42ec-9b95-86fc33117c65", "tag": "4dbda732-75b7-4922-aed4-c2911cb6c8b5"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:50:16.563231 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-b7df7e97-ecd4-4e19-8001-b296b02a22d1 req-f93ba6df-a5a6-43bd-b1f4-1a6ee285e72e service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:16.564497 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-b7df7e97-ecd4-4e19-8001-b296b02a22d1 req-f93ba6df-a5a6-43bd-b1f4-1a6ee285e72e service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:16.566008 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-b7df7e97-ecd4-4e19-8001-b296b02a22d1 req-f93ba6df-a5a6-43bd-b1f4-1a6ee285e72e service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:16.636842 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-b7df7e97-ecd4-4e19-8001-b296b02a22d1 req-f93ba6df-a5a6-43bd-b1f4-1a6ee285e72e service nova] Creating event network-changed:4dbda732-75b7-4922-aed4-c2911cb6c8b5 for instance d4ed98fc-5acc-42ec-9b95-86fc33117c65 on hv-cinder-85282 Aug 12 11:50:16.642962 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-b7df7e97-ecd4-4e19-8001-b296b02a22d1 req-f93ba6df-a5a6-43bd-b1f4-1a6ee285e72e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132282) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 12 11:50:16.644995 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-b7df7e97-ecd4-4e19-8001-b296b02a22d1 req-f93ba6df-a5a6-43bd-b1f4-1a6ee285e72e service nova] Acquired lock "compute-rpcapi-router" {{(pid=132282) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 12 11:50:16.647102 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f9dd9f36-9250-49e2-85bb-2b8690e240fe None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:16.649930 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f9dd9f36-9250-49e2-85bb-2b8690e240fe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:16.650664 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f9dd9f36-9250-49e2-85bb-2b8690e240fe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:16.662173 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f9dd9f36-9250-49e2-85bb-2b8690e240fe None None] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:16.664949 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f9dd9f36-9250-49e2-85bb-2b8690e240fe None None] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:16.668080 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f9dd9f36-9250-49e2-85bb-2b8690e240fe None None] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:16.682882 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.compute.rpcapi [None req-f9dd9f36-9250-49e2-85bb-2b8690e240fe None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 12 11:50:16.684743 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f9dd9f36-9250-49e2-85bb-2b8690e240fe None None] Releasing lock "compute-rpcapi-router" {{(pid=132282) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 12 11:50:16.730904 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-f9dd9f36-9250-49e2-85bb-2b8690e240fe None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.679788 Aug 12 11:50:16.732441 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 19/41] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:50:16.743938 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d2697f9e-8f78-40b7-9da1-dc830cceba57 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:16.746480 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d2697f9e-8f78-40b7-9da1-dc830cceba57 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:16.765830 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d2697f9e-8f78-40b7-9da1-dc830cceba57 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:16.768684 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d2697f9e-8f78-40b7-9da1-dc830cceba57 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:16.770322 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d2697f9e-8f78-40b7-9da1-dc830cceba57 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:16.773843 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d2697f9e-8f78-40b7-9da1-dc830cceba57 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:16.775515 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d2697f9e-8f78-40b7-9da1-dc830cceba57 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:16.777528 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d2697f9e-8f78-40b7-9da1-dc830cceba57 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:17.406905 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell0:SELECT=30 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:17.561337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-0981590f-876f-474a-ab96-aa9b01c6a600 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:17.582900 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-0981590f-876f-474a-ab96-aa9b01c6a600 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 1.135311 Aug 12 11:50:17.624519 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 23/42] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:16 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:17.637765 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-bd4c2435-c258-401b-8664-ed7fbdfcce8d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:17.638382 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-bd4c2435-c258-401b-8664-ed7fbdfcce8d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:17.646013 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bd4c2435-c258-401b-8664-ed7fbdfcce8d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:17.656781 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bd4c2435-c258-401b-8664-ed7fbdfcce8d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:17.657528 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bd4c2435-c258-401b-8664-ed7fbdfcce8d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:17.658476 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bd4c2435-c258-401b-8664-ed7fbdfcce8d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:17.659101 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bd4c2435-c258-401b-8664-ed7fbdfcce8d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:17.660022 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bd4c2435-c258-401b-8664-ed7fbdfcce8d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:17.682343 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d2697f9e-8f78-40b7-9da1-dc830cceba57 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:17.691391 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-d2697f9e-8f78-40b7-9da1-dc830cceba57 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1366 microversion: 2.1 time: 0.957716 Aug 12 11:50:17.705259 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 20/43] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:16 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1366 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:17.712440 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-ec87a8a1-4975-49d7-bc30-c424594b9e98 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:17.713326 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-ec87a8a1-4975-49d7-bc30-c424594b9e98 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:17.715541 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=11 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:17.722199 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ec87a8a1-4975-49d7-bc30-c424594b9e98 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:17.723391 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ec87a8a1-4975-49d7-bc30-c424594b9e98 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:17.724340 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ec87a8a1-4975-49d7-bc30-c424594b9e98 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:17.725385 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ec87a8a1-4975-49d7-bc30-c424594b9e98 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:17.726350 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ec87a8a1-4975-49d7-bc30-c424594b9e98 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:17.726994 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ec87a8a1-4975-49d7-bc30-c424594b9e98 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:19.282534 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-bd4c2435-c258-401b-8664-ed7fbdfcce8d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:19.290742 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-bd4c2435-c258-401b-8664-ed7fbdfcce8d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 1.660183 Aug 12 11:50:19.291328 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 24/44] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:17 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:19.418553 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-ec87a8a1-4975-49d7-bc30-c424594b9e98 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:19.427843 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-ec87a8a1-4975-49d7-bc30-c424594b9e98 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:19.429888 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-ec87a8a1-4975-49d7-bc30-c424594b9e98 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:19.437005 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-ec87a8a1-4975-49d7-bc30-c424594b9e98 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 1.730283 Aug 12 11:50:19.437597 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 21/45] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:17 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:19.446743 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-3811a364-9dcb-42c1-a03f-bd7c37dbd902 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:19.458128 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-3811a364-9dcb-42c1-a03f-bd7c37dbd902 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:19.464264 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3811a364-9dcb-42c1-a03f-bd7c37dbd902 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:19.465103 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3811a364-9dcb-42c1-a03f-bd7c37dbd902 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:19.465802 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3811a364-9dcb-42c1-a03f-bd7c37dbd902 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:19.467073 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3811a364-9dcb-42c1-a03f-bd7c37dbd902 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:19.469859 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3811a364-9dcb-42c1-a03f-bd7c37dbd902 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:19.470742 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3811a364-9dcb-42c1-a03f-bd7c37dbd902 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:19.564278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-60f43937-6281-487f-a7fa-ea302e835824 req-ee5b085a-0dd5-493b-8147-6b87eb399e68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17168892-79e0-4148-94f8-9034d13d060c", "tag": "d7d8ffb8-c0a5-4afc-b4c5-f929667db09c"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:50:19.579979 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-60f43937-6281-487f-a7fa-ea302e835824 req-ee5b085a-0dd5-493b-8147-6b87eb399e68 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:19.580309 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-60f43937-6281-487f-a7fa-ea302e835824 req-ee5b085a-0dd5-493b-8147-6b87eb399e68 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:19.580635 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-60f43937-6281-487f-a7fa-ea302e835824 req-ee5b085a-0dd5-493b-8147-6b87eb399e68 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:19.600819 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-60f43937-6281-487f-a7fa-ea302e835824 req-ee5b085a-0dd5-493b-8147-6b87eb399e68 service nova] Creating event network-changed:d7d8ffb8-c0a5-4afc-b4c5-f929667db09c for instance 17168892-79e0-4148-94f8-9034d13d060c on hv-cinder-85282 Aug 12 11:50:19.601346 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-60f43937-6281-487f-a7fa-ea302e835824 req-ee5b085a-0dd5-493b-8147-6b87eb399e68 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132281) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 12 11:50:19.601734 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-60f43937-6281-487f-a7fa-ea302e835824 req-ee5b085a-0dd5-493b-8147-6b87eb399e68 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132281) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 12 11:50:19.602781 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f924bd34-79a8-48a6-93c2-1f1b5fda949f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:19.603258 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f924bd34-79a8-48a6-93c2-1f1b5fda949f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:19.603664 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f924bd34-79a8-48a6-93c2-1f1b5fda949f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:19.604643 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f924bd34-79a8-48a6-93c2-1f1b5fda949f None None] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:19.605249 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f924bd34-79a8-48a6-93c2-1f1b5fda949f None None] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:19.605828 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f924bd34-79a8-48a6-93c2-1f1b5fda949f None None] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:19.617404 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.compute.rpcapi [None req-f924bd34-79a8-48a6-93c2-1f1b5fda949f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 12 11:50:19.618592 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f924bd34-79a8-48a6-93c2-1f1b5fda949f None None] Releasing lock "compute-rpcapi-router" {{(pid=132281) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 12 11:50:19.636462 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-f924bd34-79a8-48a6-93c2-1f1b5fda949f None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.343436 Aug 12 11:50:19.637139 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 25/46] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:50:19.644938 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-ece9bb3c-5407-4ea2-8e83-b7d1b2876504 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:19.645963 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-ece9bb3c-5407-4ea2-8e83-b7d1b2876504 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:19.656290 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ece9bb3c-5407-4ea2-8e83-b7d1b2876504 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:19.656811 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ece9bb3c-5407-4ea2-8e83-b7d1b2876504 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:19.658477 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ece9bb3c-5407-4ea2-8e83-b7d1b2876504 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:19.659747 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ece9bb3c-5407-4ea2-8e83-b7d1b2876504 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:19.660316 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ece9bb3c-5407-4ea2-8e83-b7d1b2876504 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:19.661609 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ece9bb3c-5407-4ea2-8e83-b7d1b2876504 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:19.843821 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-3811a364-9dcb-42c1-a03f-bd7c37dbd902 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:19.855945 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-3811a364-9dcb-42c1-a03f-bd7c37dbd902 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.416720 Aug 12 11:50:19.857075 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 22/47] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:19 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:19.877805 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-1c200e76-597b-4387-a2cf-22c8da095973 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:19.878955 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-1c200e76-597b-4387-a2cf-22c8da095973 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:19.890273 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1c200e76-597b-4387-a2cf-22c8da095973 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:19.891054 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1c200e76-597b-4387-a2cf-22c8da095973 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:19.891802 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1c200e76-597b-4387-a2cf-22c8da095973 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:19.892701 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1c200e76-597b-4387-a2cf-22c8da095973 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:19.893435 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1c200e76-597b-4387-a2cf-22c8da095973 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:19.894177 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1c200e76-597b-4387-a2cf-22c8da095973 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:20.016987 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-ece9bb3c-5407-4ea2-8e83-b7d1b2876504 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:20.020839 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=87 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:20.035965 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-ece9bb3c-5407-4ea2-8e83-b7d1b2876504 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 0.397109 Aug 12 11:50:20.037275 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 26/48] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:19 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:20.044223 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-f177352b-a6d2-4ef2-b743-df6809e1f5e4 req-dbd25b5b-e6b7-46bf-80d2-06e2967b202c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5109a18a-e7ab-4ce9-904b-63c1dfc7197a", "tag": "193da7e7-7328-4dc4-bfb7-5c909c304ee1"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:50:20.058634 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-f177352b-a6d2-4ef2-b743-df6809e1f5e4 req-dbd25b5b-e6b7-46bf-80d2-06e2967b202c service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:20.059128 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-f177352b-a6d2-4ef2-b743-df6809e1f5e4 req-dbd25b5b-e6b7-46bf-80d2-06e2967b202c service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:20.059557 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-f177352b-a6d2-4ef2-b743-df6809e1f5e4 req-dbd25b5b-e6b7-46bf-80d2-06e2967b202c service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:20.075538 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-f177352b-a6d2-4ef2-b743-df6809e1f5e4 req-dbd25b5b-e6b7-46bf-80d2-06e2967b202c service nova] Creating event network-changed:193da7e7-7328-4dc4-bfb7-5c909c304ee1 for instance 5109a18a-e7ab-4ce9-904b-63c1dfc7197a on hv-cinder-85282 Aug 12 11:50:20.081604 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-f177352b-a6d2-4ef2-b743-df6809e1f5e4 req-dbd25b5b-e6b7-46bf-80d2-06e2967b202c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041736 Aug 12 11:50:20.087209 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 27/49] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:50:20.213440 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-1c200e76-597b-4387-a2cf-22c8da095973 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:20.226477 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-1c200e76-597b-4387-a2cf-22c8da095973 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1366 microversion: 2.1 time: 0.367363 Aug 12 11:50:20.227604 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 23/50] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:19 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1366 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:20.314264 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-47ec8c8f-d1c5-4374-9ede-03e4a8f7bbaf tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:20.315052 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-47ec8c8f-d1c5-4374-9ede-03e4a8f7bbaf tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:20.322636 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-47ec8c8f-d1c5-4374-9ede-03e4a8f7bbaf tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:20.323302 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-47ec8c8f-d1c5-4374-9ede-03e4a8f7bbaf tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:20.323964 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-47ec8c8f-d1c5-4374-9ede-03e4a8f7bbaf tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:20.324965 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-47ec8c8f-d1c5-4374-9ede-03e4a8f7bbaf tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:20.325577 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-47ec8c8f-d1c5-4374-9ede-03e4a8f7bbaf tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:20.325981 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-47ec8c8f-d1c5-4374-9ede-03e4a8f7bbaf tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:20.460586 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-06b38968-3325-4bcc-b3a6-27b796f1b4e6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:20.461514 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-06b38968-3325-4bcc-b3a6-27b796f1b4e6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:20.471409 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-06b38968-3325-4bcc-b3a6-27b796f1b4e6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:20.474520 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-06b38968-3325-4bcc-b3a6-27b796f1b4e6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:20.475070 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-06b38968-3325-4bcc-b3a6-27b796f1b4e6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:20.475914 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-06b38968-3325-4bcc-b3a6-27b796f1b4e6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:20.477653 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-06b38968-3325-4bcc-b3a6-27b796f1b4e6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:20.478676 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-06b38968-3325-4bcc-b3a6-27b796f1b4e6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:20.789220 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-47ec8c8f-d1c5-4374-9ede-03e4a8f7bbaf tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:20.796841 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-47ec8c8f-d1c5-4374-9ede-03e4a8f7bbaf tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.487060 Aug 12 11:50:20.797525 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 28/51] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:20 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:20.877371 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-5a1a75df-0d13-4320-8d34-194895e03c1b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:20.877978 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-5a1a75df-0d13-4320-8d34-194895e03c1b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:20.885185 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5a1a75df-0d13-4320-8d34-194895e03c1b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:20.885665 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5a1a75df-0d13-4320-8d34-194895e03c1b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:20.886093 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5a1a75df-0d13-4320-8d34-194895e03c1b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:20.886811 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5a1a75df-0d13-4320-8d34-194895e03c1b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:20.887257 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5a1a75df-0d13-4320-8d34-194895e03c1b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:20.887677 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5a1a75df-0d13-4320-8d34-194895e03c1b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:20.911517 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-06b38968-3325-4bcc-b3a6-27b796f1b4e6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:20.915408 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=100 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:20.921537 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-06b38968-3325-4bcc-b3a6-27b796f1b4e6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:20.923605 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-06b38968-3325-4bcc-b3a6-27b796f1b4e6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:20.924719 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-06b38968-3325-4bcc-b3a6-27b796f1b4e6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.469058 Aug 12 11:50:20.925440 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 24/52] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:20 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:50:21.059009 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-4f2204b1-874b-43c4-be9b-1ce463302499 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:21.063571 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-4f2204b1-874b-43c4-be9b-1ce463302499 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:21.071253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4f2204b1-874b-43c4-be9b-1ce463302499 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:21.072319 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4f2204b1-874b-43c4-be9b-1ce463302499 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:21.072911 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4f2204b1-874b-43c4-be9b-1ce463302499 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:21.073965 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4f2204b1-874b-43c4-be9b-1ce463302499 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:21.074569 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4f2204b1-874b-43c4-be9b-1ce463302499 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:21.075281 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4f2204b1-874b-43c4-be9b-1ce463302499 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:21.108095 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-5a1a75df-0d13-4320-8d34-194895e03c1b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:21.121822 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-5a1a75df-0d13-4320-8d34-194895e03c1b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.248183 Aug 12 11:50:21.122407 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 29/53] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:20 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:21.239768 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-4f2204b1-874b-43c4-be9b-1ce463302499 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:21.250631 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-86971a6b-9fc4-4117-a930-41e78dcae12c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:21.251378 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-86971a6b-9fc4-4117-a930-41e78dcae12c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:21.258402 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-4f2204b1-874b-43c4-be9b-1ce463302499 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 0.204666 Aug 12 11:50:21.259754 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 25/54] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:21 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:21.267391 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86971a6b-9fc4-4117-a930-41e78dcae12c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:21.268102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86971a6b-9fc4-4117-a930-41e78dcae12c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:21.268705 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86971a6b-9fc4-4117-a930-41e78dcae12c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:21.269567 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86971a6b-9fc4-4117-a930-41e78dcae12c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:21.270576 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86971a6b-9fc4-4117-a930-41e78dcae12c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:21.271567 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86971a6b-9fc4-4117-a930-41e78dcae12c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:21.425130 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-86971a6b-9fc4-4117-a930-41e78dcae12c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:21.443025 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-86971a6b-9fc4-4117-a930-41e78dcae12c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1366 microversion: 2.1 time: 0.196629 Aug 12 11:50:21.443618 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 30/55] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:21 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:21.675395 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-481248f7-6f6f-4771-9e23-bf231111fd00 req-b6187143-e6a5-470c-adc6-5f1497606f3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "712bb3a1-789a-442f-8d59-a635f0896531", "tag": "0a1aa4d3-f810-4d8a-b28b-30a0d82ce0c9"}, {"name": "network-changed", "server_uuid": "6dba7589-a4cf-4842-953b-0218eae4d3db", "tag": "e1b3cbaf-769e-41d6-b51a-8e930b076512"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:50:21.688102 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-481248f7-6f6f-4771-9e23-bf231111fd00 req-b6187143-e6a5-470c-adc6-5f1497606f3e service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:21.688690 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-481248f7-6f6f-4771-9e23-bf231111fd00 req-b6187143-e6a5-470c-adc6-5f1497606f3e service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:21.689440 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-481248f7-6f6f-4771-9e23-bf231111fd00 req-b6187143-e6a5-470c-adc6-5f1497606f3e service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:21.703332 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-481248f7-6f6f-4771-9e23-bf231111fd00 req-b6187143-e6a5-470c-adc6-5f1497606f3e service nova] Creating event network-changed:0a1aa4d3-f810-4d8a-b28b-30a0d82ce0c9 for instance 712bb3a1-789a-442f-8d59-a635f0896531 on hv-cinder-85282 Aug 12 11:50:21.704053 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-481248f7-6f6f-4771-9e23-bf231111fd00 req-b6187143-e6a5-470c-adc6-5f1497606f3e service nova] Creating event network-changed:e1b3cbaf-769e-41d6-b51a-8e930b076512 for instance 6dba7589-a4cf-4842-953b-0218eae4d3db on hv-cinder-85282 Aug 12 11:50:21.711805 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-481248f7-6f6f-4771-9e23-bf231111fd00 req-b6187143-e6a5-470c-adc6-5f1497606f3e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039998 Aug 12 11:50:21.712441 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 26/56] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:50:21.819176 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-2eca30eb-0597-4c02-bd46-ba3a22a8a47b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:21.819700 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-2eca30eb-0597-4c02-bd46-ba3a22a8a47b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:21.826549 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2eca30eb-0597-4c02-bd46-ba3a22a8a47b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:21.827073 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2eca30eb-0597-4c02-bd46-ba3a22a8a47b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:21.827877 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2eca30eb-0597-4c02-bd46-ba3a22a8a47b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:21.828776 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2eca30eb-0597-4c02-bd46-ba3a22a8a47b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:21.829275 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2eca30eb-0597-4c02-bd46-ba3a22a8a47b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:21.829875 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2eca30eb-0597-4c02-bd46-ba3a22a8a47b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:21.951585 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-f97c240d-9916-4551-9d9a-2d8a3b5f1786 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:21.952679 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-f97c240d-9916-4551-9d9a-2d8a3b5f1786 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:21.973713 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f97c240d-9916-4551-9d9a-2d8a3b5f1786 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:21.978825 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f97c240d-9916-4551-9d9a-2d8a3b5f1786 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:21.979926 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f97c240d-9916-4551-9d9a-2d8a3b5f1786 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:21.988986 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f97c240d-9916-4551-9d9a-2d8a3b5f1786 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:21.990118 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f97c240d-9916-4551-9d9a-2d8a3b5f1786 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:21.993248 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f97c240d-9916-4551-9d9a-2d8a3b5f1786 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:22.036230 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-2eca30eb-0597-4c02-bd46-ba3a22a8a47b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:22.044801 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-2eca30eb-0597-4c02-bd46-ba3a22a8a47b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.229860 Aug 12 11:50:22.058944 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 31/57] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:21 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:22.148261 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-13fff57f-b6e3-45e5-b8f8-306a5434d4e2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:22.148988 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-13fff57f-b6e3-45e5-b8f8-306a5434d4e2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:22.160804 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-13fff57f-b6e3-45e5-b8f8-306a5434d4e2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:22.163054 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-13fff57f-b6e3-45e5-b8f8-306a5434d4e2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:22.163815 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-13fff57f-b6e3-45e5-b8f8-306a5434d4e2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:22.165960 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-13fff57f-b6e3-45e5-b8f8-306a5434d4e2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:22.168408 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-13fff57f-b6e3-45e5-b8f8-306a5434d4e2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:22.168948 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-13fff57f-b6e3-45e5-b8f8-306a5434d4e2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:22.188252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-f97c240d-9916-4551-9d9a-2d8a3b5f1786 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:22.198569 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-f97c240d-9916-4551-9d9a-2d8a3b5f1786 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:22.201826 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-f97c240d-9916-4551-9d9a-2d8a3b5f1786 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:22.204206 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-f97c240d-9916-4551-9d9a-2d8a3b5f1786 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.259208 Aug 12 11:50:22.207712 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 27/58] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:21 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:50:22.279435 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-55a90e2c-1b4c-4ea6-ad85-af911c28a4d6 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:22.280116 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-55a90e2c-1b4c-4ea6-ad85-af911c28a4d6 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:22.287866 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-55a90e2c-1b4c-4ea6-ad85-af911c28a4d6 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:22.288608 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-55a90e2c-1b4c-4ea6-ad85-af911c28a4d6 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:22.289116 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-55a90e2c-1b4c-4ea6-ad85-af911c28a4d6 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:22.289930 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-55a90e2c-1b4c-4ea6-ad85-af911c28a4d6 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:22.290440 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-55a90e2c-1b4c-4ea6-ad85-af911c28a4d6 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:22.291313 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-55a90e2c-1b4c-4ea6-ad85-af911c28a4d6 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:22.377372 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-13fff57f-b6e3-45e5-b8f8-306a5434d4e2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:22.385783 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-13fff57f-b6e3-45e5-b8f8-306a5434d4e2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.242253 Aug 12 11:50:22.386708 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 32/59] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:22 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:22.456669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-55a90e2c-1b4c-4ea6-ad85-af911c28a4d6 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:22.464255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-ade8fe9c-95ce-4143-b41e-81e05e13268c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:22.464860 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-ade8fe9c-95ce-4143-b41e-81e05e13268c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:22.469519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-55a90e2c-1b4c-4ea6-ad85-af911c28a4d6 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 0.193941 Aug 12 11:50:22.470701 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 28/60] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:22 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:22.470903 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ade8fe9c-95ce-4143-b41e-81e05e13268c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:22.471901 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ade8fe9c-95ce-4143-b41e-81e05e13268c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:22.472340 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ade8fe9c-95ce-4143-b41e-81e05e13268c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:22.473030 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ade8fe9c-95ce-4143-b41e-81e05e13268c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:22.473644 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ade8fe9c-95ce-4143-b41e-81e05e13268c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:22.474061 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ade8fe9c-95ce-4143-b41e-81e05e13268c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:22.630731 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-ade8fe9c-95ce-4143-b41e-81e05e13268c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:22.640090 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-ade8fe9c-95ce-4143-b41e-81e05e13268c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1366 microversion: 2.1 time: 0.179285 Aug 12 11:50:22.640652 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 33/61] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:22 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:23.068740 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-6e730741-3556-49f1-93aa-9cfe6f21e832 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:23.069385 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-6e730741-3556-49f1-93aa-9cfe6f21e832 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:23.075677 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6e730741-3556-49f1-93aa-9cfe6f21e832 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:23.076152 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6e730741-3556-49f1-93aa-9cfe6f21e832 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:23.076744 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6e730741-3556-49f1-93aa-9cfe6f21e832 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:23.077438 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6e730741-3556-49f1-93aa-9cfe6f21e832 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:23.077883 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6e730741-3556-49f1-93aa-9cfe6f21e832 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:23.078301 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6e730741-3556-49f1-93aa-9cfe6f21e832 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:23.220663 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-6e730741-3556-49f1-93aa-9cfe6f21e832 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:23.227483 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-d9cf7404-2d76-4298-816a-648fd4c8a69d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:23.228203 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-6e730741-3556-49f1-93aa-9cfe6f21e832 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.163354 Aug 12 11:50:23.228467 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-d9cf7404-2d76-4298-816a-648fd4c8a69d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:23.228770 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 29/62] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:23 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:23.235943 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d9cf7404-2d76-4298-816a-648fd4c8a69d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:23.236635 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d9cf7404-2d76-4298-816a-648fd4c8a69d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:23.237219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d9cf7404-2d76-4298-816a-648fd4c8a69d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:23.238053 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d9cf7404-2d76-4298-816a-648fd4c8a69d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:23.238660 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d9cf7404-2d76-4298-816a-648fd4c8a69d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:23.239214 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d9cf7404-2d76-4298-816a-648fd4c8a69d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:23.383178 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-d9cf7404-2d76-4298-816a-648fd4c8a69d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:23.389639 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-d9cf7404-2d76-4298-816a-648fd4c8a69d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:23.391474 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-d9cf7404-2d76-4298-816a-648fd4c8a69d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:23.392580 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-d9cf7404-2d76-4298-816a-648fd4c8a69d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.169052 Aug 12 11:50:23.393130 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 34/63] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:23 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:23.409196 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-9951c64a-48ec-49ee-888a-78c3a17dcc61 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:23.410086 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-9951c64a-48ec-49ee-888a-78c3a17dcc61 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:23.417100 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9951c64a-48ec-49ee-888a-78c3a17dcc61 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:23.417659 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9951c64a-48ec-49ee-888a-78c3a17dcc61 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:23.418059 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9951c64a-48ec-49ee-888a-78c3a17dcc61 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:23.418810 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9951c64a-48ec-49ee-888a-78c3a17dcc61 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:23.419256 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9951c64a-48ec-49ee-888a-78c3a17dcc61 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:23.419674 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9951c64a-48ec-49ee-888a-78c3a17dcc61 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:23.495057 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-b1d2eadd-8dca-4fc3-a0b1-9e75b0012f6e tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:23.495783 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-b1d2eadd-8dca-4fc3-a0b1-9e75b0012f6e tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:23.507416 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b1d2eadd-8dca-4fc3-a0b1-9e75b0012f6e tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:23.508027 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b1d2eadd-8dca-4fc3-a0b1-9e75b0012f6e tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:23.508570 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b1d2eadd-8dca-4fc3-a0b1-9e75b0012f6e tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:23.510920 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b1d2eadd-8dca-4fc3-a0b1-9e75b0012f6e tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:23.512459 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b1d2eadd-8dca-4fc3-a0b1-9e75b0012f6e tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:23.513839 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b1d2eadd-8dca-4fc3-a0b1-9e75b0012f6e tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:23.584962 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-9951c64a-48ec-49ee-888a-78c3a17dcc61 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:23.594181 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-9951c64a-48ec-49ee-888a-78c3a17dcc61 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.189192 Aug 12 11:50:23.601720 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 30/64] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:23 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:23.661427 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-53e55e1c-e9bb-4442-9b42-c840743663b2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:23.662263 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-53e55e1c-e9bb-4442-9b42-c840743663b2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:23.668871 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-53e55e1c-e9bb-4442-9b42-c840743663b2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:23.669479 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-53e55e1c-e9bb-4442-9b42-c840743663b2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:23.670041 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-53e55e1c-e9bb-4442-9b42-c840743663b2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:23.670962 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-53e55e1c-e9bb-4442-9b42-c840743663b2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:23.671496 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-53e55e1c-e9bb-4442-9b42-c840743663b2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:23.672015 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-53e55e1c-e9bb-4442-9b42-c840743663b2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:23.689674 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-b1d2eadd-8dca-4fc3-a0b1-9e75b0012f6e tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:23.699934 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-b1d2eadd-8dca-4fc3-a0b1-9e75b0012f6e tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 0.213350 Aug 12 11:50:23.702026 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 35/65] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:23 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:23.826206 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-53e55e1c-e9bb-4442-9b42-c840743663b2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:23.838462 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-53e55e1c-e9bb-4442-9b42-c840743663b2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1366 microversion: 2.1 time: 0.180882 Aug 12 11:50:23.839161 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 31/66] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:23 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:24.249091 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-b81d7960-9c97-4b60-a077-37d681c4b9c2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:24.249710 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-b81d7960-9c97-4b60-a077-37d681c4b9c2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:24.255846 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b81d7960-9c97-4b60-a077-37d681c4b9c2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:24.256324 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b81d7960-9c97-4b60-a077-37d681c4b9c2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:24.257250 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b81d7960-9c97-4b60-a077-37d681c4b9c2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:24.257948 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b81d7960-9c97-4b60-a077-37d681c4b9c2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:24.258380 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b81d7960-9c97-4b60-a077-37d681c4b9c2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:24.258891 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b81d7960-9c97-4b60-a077-37d681c4b9c2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:24.397851 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-b81d7960-9c97-4b60-a077-37d681c4b9c2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:24.405387 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-b81d7960-9c97-4b60-a077-37d681c4b9c2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.160091 Aug 12 11:50:24.406361 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 36/67] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:24 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:24.416842 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-18eecc37-d325-4846-ab8b-3f597cb24c69 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:24.417679 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-18eecc37-d325-4846-ab8b-3f597cb24c69 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:24.423804 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-18eecc37-d325-4846-ab8b-3f597cb24c69 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:24.424374 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-18eecc37-d325-4846-ab8b-3f597cb24c69 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:24.424872 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-18eecc37-d325-4846-ab8b-3f597cb24c69 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:24.425616 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-18eecc37-d325-4846-ab8b-3f597cb24c69 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:24.426129 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-18eecc37-d325-4846-ab8b-3f597cb24c69 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:24.426631 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-18eecc37-d325-4846-ab8b-3f597cb24c69 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:24.555961 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-18eecc37-d325-4846-ab8b-3f597cb24c69 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:24.563968 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-18eecc37-d325-4846-ab8b-3f597cb24c69 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:24.565463 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-18eecc37-d325-4846-ab8b-3f597cb24c69 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:24.566556 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-18eecc37-d325-4846-ab8b-3f597cb24c69 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.153641 Aug 12 11:50:24.567152 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 32/68] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:24 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:50:24.622907 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-62ddee0e-5012-4c5d-8917-e19444c852d6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:24.623523 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-62ddee0e-5012-4c5d-8917-e19444c852d6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:24.629376 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-62ddee0e-5012-4c5d-8917-e19444c852d6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:24.629856 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-62ddee0e-5012-4c5d-8917-e19444c852d6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:24.630298 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-62ddee0e-5012-4c5d-8917-e19444c852d6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:24.631450 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-62ddee0e-5012-4c5d-8917-e19444c852d6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:24.632093 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-62ddee0e-5012-4c5d-8917-e19444c852d6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:24.632442 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-62ddee0e-5012-4c5d-8917-e19444c852d6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:24.728276 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-039b7ff9-34ed-4d7d-8bdf-9528d09087c7 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:24.729225 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-039b7ff9-34ed-4d7d-8bdf-9528d09087c7 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:24.736708 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-039b7ff9-34ed-4d7d-8bdf-9528d09087c7 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:24.738013 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-039b7ff9-34ed-4d7d-8bdf-9528d09087c7 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:24.738525 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-039b7ff9-34ed-4d7d-8bdf-9528d09087c7 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:24.739421 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-039b7ff9-34ed-4d7d-8bdf-9528d09087c7 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:24.739948 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-039b7ff9-34ed-4d7d-8bdf-9528d09087c7 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:24.742403 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-039b7ff9-34ed-4d7d-8bdf-9528d09087c7 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:24.937613 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-62ddee0e-5012-4c5d-8917-e19444c852d6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:24.946917 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-62ddee0e-5012-4c5d-8917-e19444c852d6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.327621 Aug 12 11:50:24.948735 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 37/69] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:24 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:24.954516 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-7d4bfc13-f737-407c-a60b-bcfc3c168692 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:24.957227 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-7d4bfc13-f737-407c-a60b-bcfc3c168692 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:24.966026 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7d4bfc13-f737-407c-a60b-bcfc3c168692 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:24.966781 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7d4bfc13-f737-407c-a60b-bcfc3c168692 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:24.967448 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7d4bfc13-f737-407c-a60b-bcfc3c168692 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:24.968358 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7d4bfc13-f737-407c-a60b-bcfc3c168692 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:24.969244 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7d4bfc13-f737-407c-a60b-bcfc3c168692 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:24.970171 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7d4bfc13-f737-407c-a60b-bcfc3c168692 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:25.323689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-039b7ff9-34ed-4d7d-8bdf-9528d09087c7 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:25.332545 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-039b7ff9-34ed-4d7d-8bdf-9528d09087c7 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 0.610453 Aug 12 11:50:25.333647 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 33/70] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:24 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:25.427363 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-a2c4c572-da61-4fcd-8a61-6aab959f9426 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:25.429124 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-a2c4c572-da61-4fcd-8a61-6aab959f9426 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:25.435983 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a2c4c572-da61-4fcd-8a61-6aab959f9426 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:25.436470 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a2c4c572-da61-4fcd-8a61-6aab959f9426 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:25.437080 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a2c4c572-da61-4fcd-8a61-6aab959f9426 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:25.437924 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a2c4c572-da61-4fcd-8a61-6aab959f9426 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:25.438381 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a2c4c572-da61-4fcd-8a61-6aab959f9426 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:25.439187 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a2c4c572-da61-4fcd-8a61-6aab959f9426 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:25.569562 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-7d4bfc13-f737-407c-a60b-bcfc3c168692 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:25.578591 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-7d4bfc13-f737-407c-a60b-bcfc3c168692 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1366 microversion: 2.1 time: 0.627993 Aug 12 11:50:25.579506 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 38/71] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:24 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1366 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:25.602166 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-bf24c255-f6de-4fc0-b71c-d2045d8ddb73 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:25.603196 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-bf24c255-f6de-4fc0-b71c-d2045d8ddb73 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:25.610455 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bf24c255-f6de-4fc0-b71c-d2045d8ddb73 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:25.611449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bf24c255-f6de-4fc0-b71c-d2045d8ddb73 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:25.612299 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bf24c255-f6de-4fc0-b71c-d2045d8ddb73 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:25.613258 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bf24c255-f6de-4fc0-b71c-d2045d8ddb73 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:25.613723 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bf24c255-f6de-4fc0-b71c-d2045d8ddb73 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:25.614302 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bf24c255-f6de-4fc0-b71c-d2045d8ddb73 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:26.005684 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-a2c4c572-da61-4fcd-8a61-6aab959f9426 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:26.015918 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-a2c4c572-da61-4fcd-8a61-6aab959f9426 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.592623 Aug 12 11:50:26.016574 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 34/72] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:25 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:26.023200 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d78c7918-d600-4d6d-b9d0-db3ef1bb8d0e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:26.023882 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d78c7918-d600-4d6d-b9d0-db3ef1bb8d0e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:26.030977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d78c7918-d600-4d6d-b9d0-db3ef1bb8d0e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:26.031608 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d78c7918-d600-4d6d-b9d0-db3ef1bb8d0e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:26.032346 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d78c7918-d600-4d6d-b9d0-db3ef1bb8d0e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:26.033192 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d78c7918-d600-4d6d-b9d0-db3ef1bb8d0e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:26.033736 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d78c7918-d600-4d6d-b9d0-db3ef1bb8d0e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:26.034228 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d78c7918-d600-4d6d-b9d0-db3ef1bb8d0e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:26.178380 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-bf24c255-f6de-4fc0-b71c-d2045d8ddb73 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:26.187562 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-bf24c255-f6de-4fc0-b71c-d2045d8ddb73 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:26.189072 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-bf24c255-f6de-4fc0-b71c-d2045d8ddb73 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:26.197845 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-bf24c255-f6de-4fc0-b71c-d2045d8ddb73 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.593309 Aug 12 11:50:26.206636 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 39/73] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:25 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:26.354901 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-a83767db-2a02-4b1e-96e2-9ee4b30ee875 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:26.357239 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-a83767db-2a02-4b1e-96e2-9ee4b30ee875 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:26.367196 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a83767db-2a02-4b1e-96e2-9ee4b30ee875 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:26.367196 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a83767db-2a02-4b1e-96e2-9ee4b30ee875 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:26.367473 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a83767db-2a02-4b1e-96e2-9ee4b30ee875 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:26.368141 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a83767db-2a02-4b1e-96e2-9ee4b30ee875 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:26.368490 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a83767db-2a02-4b1e-96e2-9ee4b30ee875 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:26.368906 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a83767db-2a02-4b1e-96e2-9ee4b30ee875 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:26.388547 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d78c7918-d600-4d6d-b9d0-db3ef1bb8d0e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:26.398651 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-d78c7918-d600-4d6d-b9d0-db3ef1bb8d0e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.380723 Aug 12 11:50:26.400745 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 35/74] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:26 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:26.605487 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-4a688e1e-a89c-4be3-a0c7-d976a82a811a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:26.606254 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-4a688e1e-a89c-4be3-a0c7-d976a82a811a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:26.612119 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4a688e1e-a89c-4be3-a0c7-d976a82a811a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:26.612601 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4a688e1e-a89c-4be3-a0c7-d976a82a811a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:26.613032 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4a688e1e-a89c-4be3-a0c7-d976a82a811a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:26.613723 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4a688e1e-a89c-4be3-a0c7-d976a82a811a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:26.614244 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4a688e1e-a89c-4be3-a0c7-d976a82a811a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:26.614711 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4a688e1e-a89c-4be3-a0c7-d976a82a811a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:26.627121 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-a83767db-2a02-4b1e-96e2-9ee4b30ee875 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:26.643366 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-a83767db-2a02-4b1e-96e2-9ee4b30ee875 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 0.291569 Aug 12 11:50:26.644483 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 40/75] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:26 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:26.682547 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=2 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:26.771214 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-3aed09d1-a4fa-4e12-8450-6de8fde4ec40 req-31e546dc-ca6d-45ed-9687-7904ff4c279d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e56c585-652b-4059-b3f6-280d542ee20f", "tag": "22832d7b-ac7a-4e86-862c-68b38289d769"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:50:26.781336 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-3aed09d1-a4fa-4e12-8450-6de8fde4ec40 req-31e546dc-ca6d-45ed-9687-7904ff4c279d service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:26.781820 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-3aed09d1-a4fa-4e12-8450-6de8fde4ec40 req-31e546dc-ca6d-45ed-9687-7904ff4c279d service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:26.782488 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-3aed09d1-a4fa-4e12-8450-6de8fde4ec40 req-31e546dc-ca6d-45ed-9687-7904ff4c279d service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:26.794148 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-3aed09d1-a4fa-4e12-8450-6de8fde4ec40 req-31e546dc-ca6d-45ed-9687-7904ff4c279d service nova] Creating event network-changed:22832d7b-ac7a-4e86-862c-68b38289d769 for instance 5e56c585-652b-4059-b3f6-280d542ee20f on hv-cinder-85282 Aug 12 11:50:26.802320 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-3aed09d1-a4fa-4e12-8450-6de8fde4ec40 req-31e546dc-ca6d-45ed-9687-7904ff4c279d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034488 Aug 12 11:50:26.802954 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 41/76] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:50:26.847178 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-4a688e1e-a89c-4be3-a0c7-d976a82a811a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:26.854691 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-4a688e1e-a89c-4be3-a0c7-d976a82a811a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1366 microversion: 2.1 time: 0.254157 Aug 12 11:50:26.855583 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 36/77] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:26 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:27.042455 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-7ecc5286-f665-40b5-be75-ec2f791b63d8 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:27.047634 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-7ecc5286-f665-40b5-be75-ec2f791b63d8 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:27.054546 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7ecc5286-f665-40b5-be75-ec2f791b63d8 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:27.055180 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7ecc5286-f665-40b5-be75-ec2f791b63d8 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:27.055888 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7ecc5286-f665-40b5-be75-ec2f791b63d8 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:27.056582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7ecc5286-f665-40b5-be75-ec2f791b63d8 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:27.057228 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7ecc5286-f665-40b5-be75-ec2f791b63d8 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:27.057653 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7ecc5286-f665-40b5-be75-ec2f791b63d8 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:27.190778 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-7ecc5286-f665-40b5-be75-ec2f791b63d8 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:27.199103 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-7ecc5286-f665-40b5-be75-ec2f791b63d8 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.161003 Aug 12 11:50:27.199867 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 42/78] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:27 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:27.223898 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-1e6e35d2-da8e-45e1-84a7-76c822f10e27 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:27.224503 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-1e6e35d2-da8e-45e1-84a7-76c822f10e27 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:27.230864 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1e6e35d2-da8e-45e1-84a7-76c822f10e27 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:27.231341 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1e6e35d2-da8e-45e1-84a7-76c822f10e27 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:27.231885 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1e6e35d2-da8e-45e1-84a7-76c822f10e27 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:27.232436 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1e6e35d2-da8e-45e1-84a7-76c822f10e27 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:27.232954 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1e6e35d2-da8e-45e1-84a7-76c822f10e27 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:27.233677 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1e6e35d2-da8e-45e1-84a7-76c822f10e27 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:27.364784 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-1e6e35d2-da8e-45e1-84a7-76c822f10e27 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:27.374332 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-1e6e35d2-da8e-45e1-84a7-76c822f10e27 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:27.375879 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-1e6e35d2-da8e-45e1-84a7-76c822f10e27 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:27.377001 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-1e6e35d2-da8e-45e1-84a7-76c822f10e27 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.157000 Aug 12 11:50:27.377572 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 37/79] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:27 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:27.422043 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-68468da1-d4c1-4f38-a0dd-80fc339cee42 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:27.422829 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-68468da1-d4c1-4f38-a0dd-80fc339cee42 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:27.430040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-68468da1-d4c1-4f38-a0dd-80fc339cee42 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:27.431041 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-68468da1-d4c1-4f38-a0dd-80fc339cee42 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:27.431551 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-68468da1-d4c1-4f38-a0dd-80fc339cee42 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:27.432406 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-68468da1-d4c1-4f38-a0dd-80fc339cee42 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:27.433593 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-68468da1-d4c1-4f38-a0dd-80fc339cee42 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:27.434193 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-68468da1-d4c1-4f38-a0dd-80fc339cee42 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:27.577822 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-68468da1-d4c1-4f38-a0dd-80fc339cee42 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:27.586351 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-68468da1-d4c1-4f38-a0dd-80fc339cee42 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.168339 Aug 12 11:50:27.587315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 43/80] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:27 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:27.665576 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-06c1b1f7-9b3f-43d9-b58b-a0de98682177 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:27.666391 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-06c1b1f7-9b3f-43d9-b58b-a0de98682177 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:27.672250 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-06c1b1f7-9b3f-43d9-b58b-a0de98682177 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:27.672735 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-06c1b1f7-9b3f-43d9-b58b-a0de98682177 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:27.673170 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-06c1b1f7-9b3f-43d9-b58b-a0de98682177 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:27.673980 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-06c1b1f7-9b3f-43d9-b58b-a0de98682177 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:27.674433 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-06c1b1f7-9b3f-43d9-b58b-a0de98682177 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:27.674880 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-06c1b1f7-9b3f-43d9-b58b-a0de98682177 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:27.811312 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-06c1b1f7-9b3f-43d9-b58b-a0de98682177 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:27.818680 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-06c1b1f7-9b3f-43d9-b58b-a0de98682177 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 0.157902 Aug 12 11:50:27.819237 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 38/81] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:27 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:27.876293 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-ff29293f-aa95-420f-883c-56e6367e291d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:27.877378 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-ff29293f-aa95-420f-883c-56e6367e291d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:27.883789 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ff29293f-aa95-420f-883c-56e6367e291d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:27.884271 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ff29293f-aa95-420f-883c-56e6367e291d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:27.884700 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ff29293f-aa95-420f-883c-56e6367e291d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:27.885388 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ff29293f-aa95-420f-883c-56e6367e291d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:27.885858 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ff29293f-aa95-420f-883c-56e6367e291d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:27.886260 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ff29293f-aa95-420f-883c-56e6367e291d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:28.030547 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-ff29293f-aa95-420f-883c-56e6367e291d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:28.034768 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=100 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:28.042904 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-ff29293f-aa95-420f-883c-56e6367e291d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1366 microversion: 2.1 time: 0.170484 Aug 12 11:50:28.043579 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 44/82] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:27 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:28.220377 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-ae0b490c-9c76-4c63-ae72-044a3e6aba9a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:28.221090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-ae0b490c-9c76-4c63-ae72-044a3e6aba9a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:28.226917 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ae0b490c-9c76-4c63-ae72-044a3e6aba9a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:28.227401 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ae0b490c-9c76-4c63-ae72-044a3e6aba9a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:28.227839 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ae0b490c-9c76-4c63-ae72-044a3e6aba9a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:28.228531 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ae0b490c-9c76-4c63-ae72-044a3e6aba9a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:28.228984 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ae0b490c-9c76-4c63-ae72-044a3e6aba9a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:28.229413 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ae0b490c-9c76-4c63-ae72-044a3e6aba9a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:28.363476 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-ae0b490c-9c76-4c63-ae72-044a3e6aba9a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:28.374547 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-ae0b490c-9c76-4c63-ae72-044a3e6aba9a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.157903 Aug 12 11:50:28.375562 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 39/83] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:28 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:28.399754 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-3780c4a3-688f-485b-910d-d380385fef92 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:28.400406 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-3780c4a3-688f-485b-910d-d380385fef92 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:28.406986 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3780c4a3-688f-485b-910d-d380385fef92 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:28.407643 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3780c4a3-688f-485b-910d-d380385fef92 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:28.408342 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3780c4a3-688f-485b-910d-d380385fef92 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:28.409278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3780c4a3-688f-485b-910d-d380385fef92 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:28.409884 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3780c4a3-688f-485b-910d-d380385fef92 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:28.410553 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3780c4a3-688f-485b-910d-d380385fef92 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:28.541753 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-3780c4a3-688f-485b-910d-d380385fef92 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:28.549748 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-3780c4a3-688f-485b-910d-d380385fef92 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:28.551277 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-3780c4a3-688f-485b-910d-d380385fef92 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:28.552357 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-3780c4a3-688f-485b-910d-d380385fef92 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.157157 Aug 12 11:50:28.552917 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 45/84] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:28 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:28.607591 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-fa6c5667-cb2a-4dcf-bf58-0e07eedcd6fa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:28.607591 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-fa6c5667-cb2a-4dcf-bf58-0e07eedcd6fa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:28.613275 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fa6c5667-cb2a-4dcf-bf58-0e07eedcd6fa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:28.613757 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fa6c5667-cb2a-4dcf-bf58-0e07eedcd6fa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:28.614215 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fa6c5667-cb2a-4dcf-bf58-0e07eedcd6fa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:28.615287 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fa6c5667-cb2a-4dcf-bf58-0e07eedcd6fa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:28.616232 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fa6c5667-cb2a-4dcf-bf58-0e07eedcd6fa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:28.616696 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fa6c5667-cb2a-4dcf-bf58-0e07eedcd6fa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:28.779926 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-fa6c5667-cb2a-4dcf-bf58-0e07eedcd6fa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:28.791506 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-fa6c5667-cb2a-4dcf-bf58-0e07eedcd6fa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.188837 Aug 12 11:50:28.792270 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 40/85] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:28 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:28.838793 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-618e57dd-c18a-4ae9-af70-d9643dd646c0 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:28.839823 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-618e57dd-c18a-4ae9-af70-d9643dd646c0 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:28.846799 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-618e57dd-c18a-4ae9-af70-d9643dd646c0 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:28.847278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-618e57dd-c18a-4ae9-af70-d9643dd646c0 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:28.847759 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-618e57dd-c18a-4ae9-af70-d9643dd646c0 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:28.848578 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-618e57dd-c18a-4ae9-af70-d9643dd646c0 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:28.849160 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-618e57dd-c18a-4ae9-af70-d9643dd646c0 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:28.849820 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-618e57dd-c18a-4ae9-af70-d9643dd646c0 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:29.027700 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-618e57dd-c18a-4ae9-af70-d9643dd646c0 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:29.035506 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-618e57dd-c18a-4ae9-af70-d9643dd646c0 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 0.200621 Aug 12 11:50:29.042740 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 46/86] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:28 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:29.071298 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-79e3b501-ec67-4f26-971b-552c379eb38a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:29.071910 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-79e3b501-ec67-4f26-971b-552c379eb38a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:29.078013 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-79e3b501-ec67-4f26-971b-552c379eb38a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:29.078519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-79e3b501-ec67-4f26-971b-552c379eb38a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:29.078976 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-79e3b501-ec67-4f26-971b-552c379eb38a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:29.079658 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-79e3b501-ec67-4f26-971b-552c379eb38a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:29.080104 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-79e3b501-ec67-4f26-971b-552c379eb38a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:29.080520 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-79e3b501-ec67-4f26-971b-552c379eb38a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:29.218166 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-79e3b501-ec67-4f26-971b-552c379eb38a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:29.226259 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-79e3b501-ec67-4f26-971b-552c379eb38a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1366 microversion: 2.1 time: 0.159683 Aug 12 11:50:29.226955 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 41/87] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:29 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:29.401512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-4c4f3dfa-62de-4b62-b822-55c05eeee715 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:29.402651 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-4c4f3dfa-62de-4b62-b822-55c05eeee715 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:29.410739 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4c4f3dfa-62de-4b62-b822-55c05eeee715 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:29.411237 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4c4f3dfa-62de-4b62-b822-55c05eeee715 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:29.411675 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4c4f3dfa-62de-4b62-b822-55c05eeee715 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:29.412376 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4c4f3dfa-62de-4b62-b822-55c05eeee715 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:29.413114 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4c4f3dfa-62de-4b62-b822-55c05eeee715 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:29.413599 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4c4f3dfa-62de-4b62-b822-55c05eeee715 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:29.576866 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-224a6101-7927-4814-a6bf-335829635a02 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:29.577490 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-224a6101-7927-4814-a6bf-335829635a02 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:29.580925 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-4c4f3dfa-62de-4b62-b822-55c05eeee715 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:29.583915 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-224a6101-7927-4814-a6bf-335829635a02 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:29.584454 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-224a6101-7927-4814-a6bf-335829635a02 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:29.585383 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-224a6101-7927-4814-a6bf-335829635a02 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:29.586076 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-224a6101-7927-4814-a6bf-335829635a02 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:29.587225 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-224a6101-7927-4814-a6bf-335829635a02 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:29.587782 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-224a6101-7927-4814-a6bf-335829635a02 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:29.595042 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=100 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:29.596661 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-4c4f3dfa-62de-4b62-b822-55c05eeee715 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.200420 Aug 12 11:50:29.599886 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 47/88] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:29 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:29.763108 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-224a6101-7927-4814-a6bf-335829635a02 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:29.773053 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-224a6101-7927-4814-a6bf-335829635a02 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:29.775335 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-224a6101-7927-4814-a6bf-335829635a02 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:29.781836 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-224a6101-7927-4814-a6bf-335829635a02 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.210029 Aug 12 11:50:29.783190 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 42/89] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:29 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:29.820274 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-123c74c9-f809-417b-a5bf-4c1e99455407 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:29.823868 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-123c74c9-f809-417b-a5bf-4c1e99455407 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:29.832048 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell0:SELECT=2 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:29.840723 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-123c74c9-f809-417b-a5bf-4c1e99455407 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:29.841217 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-123c74c9-f809-417b-a5bf-4c1e99455407 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:29.841654 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-123c74c9-f809-417b-a5bf-4c1e99455407 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:29.842373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-123c74c9-f809-417b-a5bf-4c1e99455407 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:29.842850 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-123c74c9-f809-417b-a5bf-4c1e99455407 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:29.843273 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-123c74c9-f809-417b-a5bf-4c1e99455407 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:30.058440 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-c20798bb-0a0c-410d-95a4-6a60fa69b37f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:30.059260 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-c20798bb-0a0c-410d-95a4-6a60fa69b37f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:30.071534 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c20798bb-0a0c-410d-95a4-6a60fa69b37f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:30.072799 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c20798bb-0a0c-410d-95a4-6a60fa69b37f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:30.076097 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c20798bb-0a0c-410d-95a4-6a60fa69b37f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:30.084033 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c20798bb-0a0c-410d-95a4-6a60fa69b37f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:30.084770 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c20798bb-0a0c-410d-95a4-6a60fa69b37f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:30.085219 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c20798bb-0a0c-410d-95a4-6a60fa69b37f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:30.275929 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-123c74c9-f809-417b-a5bf-4c1e99455407 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:30.293051 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-123c74c9-f809-417b-a5bf-4c1e99455407 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.483251 Aug 12 11:50:30.309831 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 48/90] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:29 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:30.309831 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-b97994f7-f9ee-4055-ac60-922fcd645944 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:30.309831 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-b97994f7-f9ee-4055-ac60-922fcd645944 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:30.320073 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b97994f7-f9ee-4055-ac60-922fcd645944 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:30.320576 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b97994f7-f9ee-4055-ac60-922fcd645944 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:30.321023 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b97994f7-f9ee-4055-ac60-922fcd645944 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:30.321823 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b97994f7-f9ee-4055-ac60-922fcd645944 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:30.322279 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b97994f7-f9ee-4055-ac60-922fcd645944 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:30.322727 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b97994f7-f9ee-4055-ac60-922fcd645944 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:30.337219 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-c20798bb-0a0c-410d-95a4-6a60fa69b37f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:30.345637 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-c20798bb-0a0c-410d-95a4-6a60fa69b37f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 0.293400 Aug 12 11:50:30.346414 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 43/91] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:30 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:30.492989 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-b97994f7-f9ee-4055-ac60-922fcd645944 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:30.501607 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-b97994f7-f9ee-4055-ac60-922fcd645944 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1366 microversion: 2.1 time: 0.204010 Aug 12 11:50:30.511146 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 49/92] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:30 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:30.619729 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e8588876-338c-4754-b40a-a694723cb930 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:30.620409 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-e8588876-338c-4754-b40a-a694723cb930 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:30.626207 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e8588876-338c-4754-b40a-a694723cb930 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:30.626718 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e8588876-338c-4754-b40a-a694723cb930 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:30.627155 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e8588876-338c-4754-b40a-a694723cb930 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:30.627973 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e8588876-338c-4754-b40a-a694723cb930 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:30.628563 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e8588876-338c-4754-b40a-a694723cb930 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:30.629024 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e8588876-338c-4754-b40a-a694723cb930 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:30.760511 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e8588876-338c-4754-b40a-a694723cb930 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:30.768117 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e8588876-338c-4754-b40a-a694723cb930 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.152186 Aug 12 11:50:30.768701 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 44/93] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:30 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:30.805232 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-1efcfa7a-66ae-46fb-99bc-b3c22c939e18 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:30.806092 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-1efcfa7a-66ae-46fb-99bc-b3c22c939e18 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:30.812006 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1efcfa7a-66ae-46fb-99bc-b3c22c939e18 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:30.812484 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1efcfa7a-66ae-46fb-99bc-b3c22c939e18 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:30.812918 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1efcfa7a-66ae-46fb-99bc-b3c22c939e18 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:30.813607 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1efcfa7a-66ae-46fb-99bc-b3c22c939e18 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:30.814058 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1efcfa7a-66ae-46fb-99bc-b3c22c939e18 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:30.814479 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1efcfa7a-66ae-46fb-99bc-b3c22c939e18 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:30.944755 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-1efcfa7a-66ae-46fb-99bc-b3c22c939e18 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:30.952686 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-1efcfa7a-66ae-46fb-99bc-b3c22c939e18 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:30.954173 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-1efcfa7a-66ae-46fb-99bc-b3c22c939e18 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:30.955430 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-1efcfa7a-66ae-46fb-99bc-b3c22c939e18 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.154084 Aug 12 11:50:30.955979 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 50/94] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:30 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:31.323394 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d8715161-69d2-4fe6-b175-f63ef337c972 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:31.324041 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d8715161-69d2-4fe6-b175-f63ef337c972 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:31.330292 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d8715161-69d2-4fe6-b175-f63ef337c972 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:31.330822 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d8715161-69d2-4fe6-b175-f63ef337c972 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:31.331252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d8715161-69d2-4fe6-b175-f63ef337c972 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:31.332210 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d8715161-69d2-4fe6-b175-f63ef337c972 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:31.332665 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d8715161-69d2-4fe6-b175-f63ef337c972 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:31.333088 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d8715161-69d2-4fe6-b175-f63ef337c972 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:31.369509 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-dd038ad3-fa16-4394-8a5d-9f2e29f5cca3 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:31.370112 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-dd038ad3-fa16-4394-8a5d-9f2e29f5cca3 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:31.375956 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dd038ad3-fa16-4394-8a5d-9f2e29f5cca3 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:31.376433 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dd038ad3-fa16-4394-8a5d-9f2e29f5cca3 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:31.376858 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dd038ad3-fa16-4394-8a5d-9f2e29f5cca3 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:31.377534 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dd038ad3-fa16-4394-8a5d-9f2e29f5cca3 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:31.377977 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dd038ad3-fa16-4394-8a5d-9f2e29f5cca3 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:31.378390 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dd038ad3-fa16-4394-8a5d-9f2e29f5cca3 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:31.516132 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d8715161-69d2-4fe6-b175-f63ef337c972 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:31.524389 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-d8715161-69d2-4fe6-b175-f63ef337c972 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.205605 Aug 12 11:50:31.525029 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 45/95] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:31 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:31.530089 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-8db9db5f-f025-4138-b711-358eee4077fd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:31.530714 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-8db9db5f-f025-4138-b711-358eee4077fd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:31.538862 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8db9db5f-f025-4138-b711-358eee4077fd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:31.539564 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8db9db5f-f025-4138-b711-358eee4077fd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:31.540476 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8db9db5f-f025-4138-b711-358eee4077fd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:31.541250 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8db9db5f-f025-4138-b711-358eee4077fd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:31.541774 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8db9db5f-f025-4138-b711-358eee4077fd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:31.542854 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8db9db5f-f025-4138-b711-358eee4077fd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:31.552721 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-dd038ad3-fa16-4394-8a5d-9f2e29f5cca3 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:31.559320 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-dd038ad3-fa16-4394-8a5d-9f2e29f5cca3 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 0.193990 Aug 12 11:50:31.559950 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 51/96] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:31 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:31.674555 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-8db9db5f-f025-4138-b711-358eee4077fd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:31.682731 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-8db9db5f-f025-4138-b711-358eee4077fd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1366 microversion: 2.1 time: 0.156336 Aug 12 11:50:31.683287 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 46/97] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:31 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:31.789555 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e62dcb2a-5035-4b58-9009-065058160ad6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:31.790191 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-e62dcb2a-5035-4b58-9009-065058160ad6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:31.796032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e62dcb2a-5035-4b58-9009-065058160ad6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:31.796513 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e62dcb2a-5035-4b58-9009-065058160ad6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:31.796943 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e62dcb2a-5035-4b58-9009-065058160ad6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:31.797624 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e62dcb2a-5035-4b58-9009-065058160ad6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:31.798072 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e62dcb2a-5035-4b58-9009-065058160ad6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:31.798495 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e62dcb2a-5035-4b58-9009-065058160ad6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:31.922246 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-e62dcb2a-5035-4b58-9009-065058160ad6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:31.930276 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-e62dcb2a-5035-4b58-9009-065058160ad6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.144984 Aug 12 11:50:31.931142 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 52/98] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:31 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:31.978136 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-17bbc10f-a5e7-4229-a592-bf7a7d77fbb8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:31.978757 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-17bbc10f-a5e7-4229-a592-bf7a7d77fbb8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:31.984476 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-17bbc10f-a5e7-4229-a592-bf7a7d77fbb8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:31.984952 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-17bbc10f-a5e7-4229-a592-bf7a7d77fbb8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:31.985378 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-17bbc10f-a5e7-4229-a592-bf7a7d77fbb8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:31.986055 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-17bbc10f-a5e7-4229-a592-bf7a7d77fbb8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:31.986496 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-17bbc10f-a5e7-4229-a592-bf7a7d77fbb8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:31.986935 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-17bbc10f-a5e7-4229-a592-bf7a7d77fbb8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:32.113279 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-17bbc10f-a5e7-4229-a592-bf7a7d77fbb8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:32.121676 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-17bbc10f-a5e7-4229-a592-bf7a7d77fbb8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:32.123386 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-17bbc10f-a5e7-4229-a592-bf7a7d77fbb8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:32.124486 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-17bbc10f-a5e7-4229-a592-bf7a7d77fbb8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.150670 Aug 12 11:50:32.125039 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 47/99] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:31 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:32.546394 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-1f58fde6-1da6-4785-ac66-5c87bee4ed22 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:32.547032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-1f58fde6-1da6-4785-ac66-5c87bee4ed22 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:32.553025 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1f58fde6-1da6-4785-ac66-5c87bee4ed22 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:32.554167 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1f58fde6-1da6-4785-ac66-5c87bee4ed22 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:32.554602 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1f58fde6-1da6-4785-ac66-5c87bee4ed22 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:32.555306 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1f58fde6-1da6-4785-ac66-5c87bee4ed22 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:32.556025 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1f58fde6-1da6-4785-ac66-5c87bee4ed22 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:32.556442 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1f58fde6-1da6-4785-ac66-5c87bee4ed22 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:32.579426 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d1991e12-c09e-47b1-a75e-4f031b307416 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:32.580260 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d1991e12-c09e-47b1-a75e-4f031b307416 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:32.586829 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d1991e12-c09e-47b1-a75e-4f031b307416 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:32.587390 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d1991e12-c09e-47b1-a75e-4f031b307416 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:32.587893 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d1991e12-c09e-47b1-a75e-4f031b307416 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:32.588651 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d1991e12-c09e-47b1-a75e-4f031b307416 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:32.589176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d1991e12-c09e-47b1-a75e-4f031b307416 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:32.589671 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d1991e12-c09e-47b1-a75e-4f031b307416 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:32.749804 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-1f58fde6-1da6-4785-ac66-5c87bee4ed22 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:32.757609 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-1f58fde6-1da6-4785-ac66-5c87bee4ed22 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.215080 Aug 12 11:50:32.762953 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 53/100] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:32 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:32.770629 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-00efefcb-2b2d-4aa2-9743-74d8174ae560 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:32.771244 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-00efefcb-2b2d-4aa2-9743-74d8174ae560 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:32.774984 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d1991e12-c09e-47b1-a75e-4f031b307416 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:32.782755 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-d1991e12-c09e-47b1-a75e-4f031b307416 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 0.206966 Aug 12 11:50:32.783666 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 48/101] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:32 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:32.783980 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-00efefcb-2b2d-4aa2-9743-74d8174ae560 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:32.784490 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-00efefcb-2b2d-4aa2-9743-74d8174ae560 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:32.785022 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-00efefcb-2b2d-4aa2-9743-74d8174ae560 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:32.785723 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-00efefcb-2b2d-4aa2-9743-74d8174ae560 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:32.786175 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-00efefcb-2b2d-4aa2-9743-74d8174ae560 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:32.786593 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-00efefcb-2b2d-4aa2-9743-74d8174ae560 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:32.935328 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-00efefcb-2b2d-4aa2-9743-74d8174ae560 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:32.942975 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-00efefcb-2b2d-4aa2-9743-74d8174ae560 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1366 microversion: 2.1 time: 0.178218 Aug 12 11:50:32.943548 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 54/102] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:32 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:32.951078 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-4feefd16-25f6-4bd7-8277-3ab5175b6ea9 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:32.952022 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-4feefd16-25f6-4bd7-8277-3ab5175b6ea9 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:32.958945 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4feefd16-25f6-4bd7-8277-3ab5175b6ea9 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:32.959959 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4feefd16-25f6-4bd7-8277-3ab5175b6ea9 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:32.960396 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4feefd16-25f6-4bd7-8277-3ab5175b6ea9 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:32.961088 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4feefd16-25f6-4bd7-8277-3ab5175b6ea9 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:32.961572 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4feefd16-25f6-4bd7-8277-3ab5175b6ea9 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:32.961991 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4feefd16-25f6-4bd7-8277-3ab5175b6ea9 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:33.087635 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-4feefd16-25f6-4bd7-8277-3ab5175b6ea9 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:33.094869 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-4feefd16-25f6-4bd7-8277-3ab5175b6ea9 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.147655 Aug 12 11:50:33.095423 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 49/103] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:32 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:33.146721 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-fbd38c0c-a603-4f24-a1c7-60e41f7c6b8a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:33.147909 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-fbd38c0c-a603-4f24-a1c7-60e41f7c6b8a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:33.153728 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fbd38c0c-a603-4f24-a1c7-60e41f7c6b8a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:33.154201 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fbd38c0c-a603-4f24-a1c7-60e41f7c6b8a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:33.154646 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fbd38c0c-a603-4f24-a1c7-60e41f7c6b8a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:33.155333 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fbd38c0c-a603-4f24-a1c7-60e41f7c6b8a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:33.155777 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fbd38c0c-a603-4f24-a1c7-60e41f7c6b8a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:33.156194 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fbd38c0c-a603-4f24-a1c7-60e41f7c6b8a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:33.283720 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-fbd38c0c-a603-4f24-a1c7-60e41f7c6b8a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:33.292188 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-fbd38c0c-a603-4f24-a1c7-60e41f7c6b8a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:33.293672 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-fbd38c0c-a603-4f24-a1c7-60e41f7c6b8a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:33.294796 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-fbd38c0c-a603-4f24-a1c7-60e41f7c6b8a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.151903 Aug 12 11:50:33.295356 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 55/104] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:33 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:33.778893 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-2f8e63dd-b7bb-4eae-b1fd-7c7987185ed4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:33.779545 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-2f8e63dd-b7bb-4eae-b1fd-7c7987185ed4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:33.785554 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2f8e63dd-b7bb-4eae-b1fd-7c7987185ed4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:33.786030 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2f8e63dd-b7bb-4eae-b1fd-7c7987185ed4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:33.786659 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2f8e63dd-b7bb-4eae-b1fd-7c7987185ed4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:33.787553 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2f8e63dd-b7bb-4eae-b1fd-7c7987185ed4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:33.788154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2f8e63dd-b7bb-4eae-b1fd-7c7987185ed4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:33.788716 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2f8e63dd-b7bb-4eae-b1fd-7c7987185ed4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:33.831532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-4910c73c-ddf4-4ee0-bedf-ec8bf7b89990 req-4ea09624-88a0-4fa5-8148-a7e0ebcd0542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ed98fc-5acc-42ec-9b95-86fc33117c65", "name": "network-vif-plugged", "status": "completed", "tag": "4dbda732-75b7-4922-aed4-c2911cb6c8b5"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:50:33.842403 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-4910c73c-ddf4-4ee0-bedf-ec8bf7b89990 req-4ea09624-88a0-4fa5-8148-a7e0ebcd0542 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:33.843178 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-4910c73c-ddf4-4ee0-bedf-ec8bf7b89990 req-4ea09624-88a0-4fa5-8148-a7e0ebcd0542 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:33.843742 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-4910c73c-ddf4-4ee0-bedf-ec8bf7b89990 req-4ea09624-88a0-4fa5-8148-a7e0ebcd0542 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:33.858984 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-4910c73c-ddf4-4ee0-bedf-ec8bf7b89990 req-4ea09624-88a0-4fa5-8148-a7e0ebcd0542 service nova] Creating event network-vif-plugged:4dbda732-75b7-4922-aed4-c2911cb6c8b5 for instance d4ed98fc-5acc-42ec-9b95-86fc33117c65 on hv-cinder-85282 Aug 12 11:50:33.864954 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-4910c73c-ddf4-4ee0-bedf-ec8bf7b89990 req-4ea09624-88a0-4fa5-8148-a7e0ebcd0542 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128413 Aug 12 11:50:33.866831 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 50/105] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:50:33.873986 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d5024bad-c89f-402a-bc95-4056ecf396b2 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:33.874980 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d5024bad-c89f-402a-bc95-4056ecf396b2 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:33.882938 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d5024bad-c89f-402a-bc95-4056ecf396b2 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:33.883425 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d5024bad-c89f-402a-bc95-4056ecf396b2 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:33.883867 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d5024bad-c89f-402a-bc95-4056ecf396b2 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:33.884551 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d5024bad-c89f-402a-bc95-4056ecf396b2 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:33.884995 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d5024bad-c89f-402a-bc95-4056ecf396b2 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:33.885417 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d5024bad-c89f-402a-bc95-4056ecf396b2 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:34.429757 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-2f8e63dd-b7bb-4eae-b1fd-7c7987185ed4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:34.436991 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d5024bad-c89f-402a-bc95-4056ecf396b2 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:34.444852 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-d5024bad-c89f-402a-bc95-4056ecf396b2 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 0.576529 Aug 12 11:50:34.445797 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 51/106] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:33 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:34.447499 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-2f8e63dd-b7bb-4eae-b1fd-7c7987185ed4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.672377 Aug 12 11:50:34.450572 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-da9e1025-0a6a-4282-b8af-9c28547b14c7 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:34.451239 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-da9e1025-0a6a-4282-b8af-9c28547b14c7 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:34.458480 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-da9e1025-0a6a-4282-b8af-9c28547b14c7 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:34.459006 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-da9e1025-0a6a-4282-b8af-9c28547b14c7 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:34.459973 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-da9e1025-0a6a-4282-b8af-9c28547b14c7 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:34.460823 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-da9e1025-0a6a-4282-b8af-9c28547b14c7 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:34.461282 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-da9e1025-0a6a-4282-b8af-9c28547b14c7 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:34.461706 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-da9e1025-0a6a-4282-b8af-9c28547b14c7 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:34.463292 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 56/107] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:33 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:34.468986 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-c0664c29-fc99-421f-b6de-75322190809b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:34.469601 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-c0664c29-fc99-421f-b6de-75322190809b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:34.478525 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c0664c29-fc99-421f-b6de-75322190809b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:34.479057 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c0664c29-fc99-421f-b6de-75322190809b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:34.479659 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c0664c29-fc99-421f-b6de-75322190809b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:34.480509 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c0664c29-fc99-421f-b6de-75322190809b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:34.481138 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c0664c29-fc99-421f-b6de-75322190809b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:34.481835 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c0664c29-fc99-421f-b6de-75322190809b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:34.685240 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-c0664c29-fc99-421f-b6de-75322190809b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:34.694728 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-c0664c29-fc99-421f-b6de-75322190809b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.230221 Aug 12 11:50:34.695493 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 57/108] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:34 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:34.700693 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-da9e1025-0a6a-4282-b8af-9c28547b14c7 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:34.706162 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-4ebd5b5b-95b8-416d-8be0-9df9afa44eb2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:34.706795 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-4ebd5b5b-95b8-416d-8be0-9df9afa44eb2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:34.713353 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4ebd5b5b-95b8-416d-8be0-9df9afa44eb2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:34.713958 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4ebd5b5b-95b8-416d-8be0-9df9afa44eb2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:34.714390 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4ebd5b5b-95b8-416d-8be0-9df9afa44eb2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:34.714763 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-da9e1025-0a6a-4282-b8af-9c28547b14c7 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1366 microversion: 2.1 time: 0.267880 Aug 12 11:50:34.715271 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4ebd5b5b-95b8-416d-8be0-9df9afa44eb2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:34.724651 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 52/109] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:34 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:34.725164 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4ebd5b5b-95b8-416d-8be0-9df9afa44eb2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:34.725164 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4ebd5b5b-95b8-416d-8be0-9df9afa44eb2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:34.847296 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-4ebd5b5b-95b8-416d-8be0-9df9afa44eb2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:34.855317 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-4ebd5b5b-95b8-416d-8be0-9df9afa44eb2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:34.856806 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-4ebd5b5b-95b8-416d-8be0-9df9afa44eb2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:34.858558 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-4ebd5b5b-95b8-416d-8be0-9df9afa44eb2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.155505 Aug 12 11:50:34.859143 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 58/110] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:34 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:35.469214 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-98a2e713-e844-456c-8183-ad16fbc06d7a tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:35.469818 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-98a2e713-e844-456c-8183-ad16fbc06d7a tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:35.476298 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-98a2e713-e844-456c-8183-ad16fbc06d7a tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:35.476740 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-98a2e713-e844-456c-8183-ad16fbc06d7a tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:35.477170 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-98a2e713-e844-456c-8183-ad16fbc06d7a tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:35.477850 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-98a2e713-e844-456c-8183-ad16fbc06d7a tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:35.478293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-98a2e713-e844-456c-8183-ad16fbc06d7a tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:35.478736 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-98a2e713-e844-456c-8183-ad16fbc06d7a tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:35.480845 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-de7e2583-657f-4a2b-ae2a-c065e5b8091b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:35.481441 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-de7e2583-657f-4a2b-ae2a-c065e5b8091b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:35.487592 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-de7e2583-657f-4a2b-ae2a-c065e5b8091b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:35.488197 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-de7e2583-657f-4a2b-ae2a-c065e5b8091b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:35.488728 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-de7e2583-657f-4a2b-ae2a-c065e5b8091b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:35.489521 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-de7e2583-657f-4a2b-ae2a-c065e5b8091b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:35.490093 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-de7e2583-657f-4a2b-ae2a-c065e5b8091b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:35.491324 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-de7e2583-657f-4a2b-ae2a-c065e5b8091b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:35.686113 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-98a2e713-e844-456c-8183-ad16fbc06d7a tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:35.686351 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-de7e2583-657f-4a2b-ae2a-c065e5b8091b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:35.690249 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-98a2e713-e844-456c-8183-ad16fbc06d7a tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 0.224777 Aug 12 11:50:35.691134 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 53/111] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:35 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:35.707525 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-de7e2583-657f-4a2b-ae2a-c065e5b8091b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.230779 Aug 12 11:50:35.708099 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 59/112] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:35 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:35.715877 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e4cd5c18-2e42-4f13-81f1-4954e012c30a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:35.716562 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-e4cd5c18-2e42-4f13-81f1-4954e012c30a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:35.722572 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e4cd5c18-2e42-4f13-81f1-4954e012c30a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:35.723111 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e4cd5c18-2e42-4f13-81f1-4954e012c30a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:35.723539 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e4cd5c18-2e42-4f13-81f1-4954e012c30a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:35.724222 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e4cd5c18-2e42-4f13-81f1-4954e012c30a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:35.725561 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e4cd5c18-2e42-4f13-81f1-4954e012c30a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:35.726231 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e4cd5c18-2e42-4f13-81f1-4954e012c30a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:35.737054 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-7b83fa0c-15c6-481b-a7b7-4bc036be5dc3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:35.738051 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-7b83fa0c-15c6-481b-a7b7-4bc036be5dc3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:35.744717 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7b83fa0c-15c6-481b-a7b7-4bc036be5dc3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:35.745374 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7b83fa0c-15c6-481b-a7b7-4bc036be5dc3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:35.745805 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7b83fa0c-15c6-481b-a7b7-4bc036be5dc3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:35.746673 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7b83fa0c-15c6-481b-a7b7-4bc036be5dc3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:35.747127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7b83fa0c-15c6-481b-a7b7-4bc036be5dc3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:35.747551 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7b83fa0c-15c6-481b-a7b7-4bc036be5dc3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:35.937382 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e4cd5c18-2e42-4f13-81f1-4954e012c30a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:35.941272 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-7b83fa0c-15c6-481b-a7b7-4bc036be5dc3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:35.945443 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e4cd5c18-2e42-4f13-81f1-4954e012c30a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.233356 Aug 12 11:50:35.945998 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 54/113] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:35 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:35.951107 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-b31ff059-a0c3-4ae7-b86c-bc1e5ce371c0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:35.951878 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-b31ff059-a0c3-4ae7-b86c-bc1e5ce371c0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:35.953137 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-7b83fa0c-15c6-481b-a7b7-4bc036be5dc3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1366 microversion: 2.1 time: 0.219783 Aug 12 11:50:35.953856 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 60/114] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:35 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:35.957969 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b31ff059-a0c3-4ae7-b86c-bc1e5ce371c0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:35.958449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b31ff059-a0c3-4ae7-b86c-bc1e5ce371c0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:35.958899 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b31ff059-a0c3-4ae7-b86c-bc1e5ce371c0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:35.960091 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b31ff059-a0c3-4ae7-b86c-bc1e5ce371c0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:35.960533 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b31ff059-a0c3-4ae7-b86c-bc1e5ce371c0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:35.960947 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b31ff059-a0c3-4ae7-b86c-bc1e5ce371c0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:36.089061 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-b31ff059-a0c3-4ae7-b86c-bc1e5ce371c0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:36.096796 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-b31ff059-a0c3-4ae7-b86c-bc1e5ce371c0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:36.098291 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-b31ff059-a0c3-4ae7-b86c-bc1e5ce371c0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:36.099413 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-b31ff059-a0c3-4ae7-b86c-bc1e5ce371c0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.152281 Aug 12 11:50:36.100608 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 55/115] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:35 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:36.713805 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-cd8e31ab-d8a8-491e-9fdc-9930805acf49 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:36.714400 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-cd8e31ab-d8a8-491e-9fdc-9930805acf49 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:36.720263 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cd8e31ab-d8a8-491e-9fdc-9930805acf49 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:36.720734 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cd8e31ab-d8a8-491e-9fdc-9930805acf49 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:36.721159 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cd8e31ab-d8a8-491e-9fdc-9930805acf49 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:36.721830 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cd8e31ab-d8a8-491e-9fdc-9930805acf49 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:36.722271 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cd8e31ab-d8a8-491e-9fdc-9930805acf49 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:36.722721 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cd8e31ab-d8a8-491e-9fdc-9930805acf49 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:36.727094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-eb99e471-1395-405a-a3a6-83589f0fcc41 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:36.727835 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-eb99e471-1395-405a-a3a6-83589f0fcc41 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:36.733698 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-eb99e471-1395-405a-a3a6-83589f0fcc41 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:36.734182 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-eb99e471-1395-405a-a3a6-83589f0fcc41 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:36.734637 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-eb99e471-1395-405a-a3a6-83589f0fcc41 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:36.735330 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-eb99e471-1395-405a-a3a6-83589f0fcc41 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:36.735783 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-eb99e471-1395-405a-a3a6-83589f0fcc41 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:36.736209 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-eb99e471-1395-405a-a3a6-83589f0fcc41 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:36.737269 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=100 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:36.919152 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-cd8e31ab-d8a8-491e-9fdc-9930805acf49 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:36.922248 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-eb99e471-1395-405a-a3a6-83589f0fcc41 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:36.926501 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-cd8e31ab-d8a8-491e-9fdc-9930805acf49 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 0.216427 Aug 12 11:50:36.927167 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 61/116] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:36 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:36.930414 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-eb99e471-1395-405a-a3a6-83589f0fcc41 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.207040 Aug 12 11:50:36.931259 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 56/117] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:36 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:36.966278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-966aa00b-5bc1-4aba-bcf3-3fa62e240e43 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:36.966869 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-966aa00b-5bc1-4aba-bcf3-3fa62e240e43 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:36.972804 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-966aa00b-5bc1-4aba-bcf3-3fa62e240e43 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:36.973184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-3d98a2da-46be-404f-927c-c4364249b2bc tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:36.973303 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-966aa00b-5bc1-4aba-bcf3-3fa62e240e43 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:36.973688 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-966aa00b-5bc1-4aba-bcf3-3fa62e240e43 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:36.973812 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-3d98a2da-46be-404f-927c-c4364249b2bc tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:36.974363 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-966aa00b-5bc1-4aba-bcf3-3fa62e240e43 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:36.974839 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-966aa00b-5bc1-4aba-bcf3-3fa62e240e43 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:36.975746 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-966aa00b-5bc1-4aba-bcf3-3fa62e240e43 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:36.979938 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3d98a2da-46be-404f-927c-c4364249b2bc tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:36.980417 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3d98a2da-46be-404f-927c-c4364249b2bc tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:36.980845 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3d98a2da-46be-404f-927c-c4364249b2bc tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:36.981519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3d98a2da-46be-404f-927c-c4364249b2bc tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:36.981963 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3d98a2da-46be-404f-927c-c4364249b2bc tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:36.982379 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3d98a2da-46be-404f-927c-c4364249b2bc tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:37.167654 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-966aa00b-5bc1-4aba-bcf3-3fa62e240e43 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:37.170738 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-3d98a2da-46be-404f-927c-c4364249b2bc tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:37.175211 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-966aa00b-5bc1-4aba-bcf3-3fa62e240e43 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.212654 Aug 12 11:50:37.175775 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 62/118] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:36 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:37.182775 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-3d98a2da-46be-404f-927c-c4364249b2bc tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1366 microversion: 2.1 time: 0.208530 Aug 12 11:50:37.182775 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 57/119] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:36 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:37.182945 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-797d88cb-a657-4571-abe4-b527dd28ca90 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:37.182945 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-797d88cb-a657-4571-abe4-b527dd28ca90 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:37.187413 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-797d88cb-a657-4571-abe4-b527dd28ca90 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:37.187885 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-797d88cb-a657-4571-abe4-b527dd28ca90 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:37.188307 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-797d88cb-a657-4571-abe4-b527dd28ca90 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:37.188976 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-797d88cb-a657-4571-abe4-b527dd28ca90 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:37.189417 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-797d88cb-a657-4571-abe4-b527dd28ca90 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:37.189831 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-797d88cb-a657-4571-abe4-b527dd28ca90 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:37.538350 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-797d88cb-a657-4571-abe4-b527dd28ca90 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:37.546295 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-797d88cb-a657-4571-abe4-b527dd28ca90 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:37.547823 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-797d88cb-a657-4571-abe4-b527dd28ca90 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:37.548937 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-797d88cb-a657-4571-abe4-b527dd28ca90 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.372252 Aug 12 11:50:37.549492 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 63/120] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:37 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:37.952728 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-f91b6786-2aa1-4144-ace9-801159ecd244 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:37.955511 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-892b4da2-96ab-442b-88fc-64b20e9047aa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:37.956142 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-892b4da2-96ab-442b-88fc-64b20e9047aa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:37.956910 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-f91b6786-2aa1-4144-ace9-801159ecd244 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:37.969082 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f91b6786-2aa1-4144-ace9-801159ecd244 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:37.971451 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-892b4da2-96ab-442b-88fc-64b20e9047aa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:37.972942 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f91b6786-2aa1-4144-ace9-801159ecd244 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:37.973678 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-892b4da2-96ab-442b-88fc-64b20e9047aa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:37.974130 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-892b4da2-96ab-442b-88fc-64b20e9047aa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:37.974932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f91b6786-2aa1-4144-ace9-801159ecd244 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:37.976894 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-892b4da2-96ab-442b-88fc-64b20e9047aa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:37.977352 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-892b4da2-96ab-442b-88fc-64b20e9047aa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:37.977779 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f91b6786-2aa1-4144-ace9-801159ecd244 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:37.978432 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f91b6786-2aa1-4144-ace9-801159ecd244 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:37.979072 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f91b6786-2aa1-4144-ace9-801159ecd244 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:37.984255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-892b4da2-96ab-442b-88fc-64b20e9047aa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:38.205995 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-892b4da2-96ab-442b-88fc-64b20e9047aa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:38.209102 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-f91b6786-2aa1-4144-ace9-801159ecd244 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:38.213542 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-892b4da2-96ab-442b-88fc-64b20e9047aa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.266115 Aug 12 11:50:38.214111 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 64/121] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:37 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:38.216578 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-f91b6786-2aa1-4144-ace9-801159ecd244 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 0.272584 Aug 12 11:50:38.217124 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 58/122] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:37 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:38.218455 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-b964c3e8-809d-4e14-8cc2-50d6612fef89 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:38.219231 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-b964c3e8-809d-4e14-8cc2-50d6612fef89 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:38.224989 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b964c3e8-809d-4e14-8cc2-50d6612fef89 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:38.225449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b964c3e8-809d-4e14-8cc2-50d6612fef89 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:38.225876 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b964c3e8-809d-4e14-8cc2-50d6612fef89 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:38.226556 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b964c3e8-809d-4e14-8cc2-50d6612fef89 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:38.227038 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b964c3e8-809d-4e14-8cc2-50d6612fef89 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:38.227448 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b964c3e8-809d-4e14-8cc2-50d6612fef89 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:38.230324 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e4f1e408-fc94-4283-aa35-cc38fb9e67e8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:38.230981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-e4f1e408-fc94-4283-aa35-cc38fb9e67e8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:38.236842 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e4f1e408-fc94-4283-aa35-cc38fb9e67e8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:38.237250 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e4f1e408-fc94-4283-aa35-cc38fb9e67e8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:38.237677 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e4f1e408-fc94-4283-aa35-cc38fb9e67e8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:38.238354 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e4f1e408-fc94-4283-aa35-cc38fb9e67e8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:38.238825 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e4f1e408-fc94-4283-aa35-cc38fb9e67e8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:38.239242 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e4f1e408-fc94-4283-aa35-cc38fb9e67e8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:38.259065 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=100 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:38.423569 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-b964c3e8-809d-4e14-8cc2-50d6612fef89 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:38.426707 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e4f1e408-fc94-4283-aa35-cc38fb9e67e8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:38.433951 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-b964c3e8-809d-4e14-8cc2-50d6612fef89 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.218844 Aug 12 11:50:38.434681 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 65/123] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:38 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:38.435245 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e4f1e408-fc94-4283-aa35-cc38fb9e67e8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1366 microversion: 2.1 time: 0.217021 Aug 12 11:50:38.435990 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 59/124] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:38 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:38.573128 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-4c48c16c-1c9b-485e-9501-5a5005fd82bd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:38.573751 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-4c48c16c-1c9b-485e-9501-5a5005fd82bd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:38.579645 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4c48c16c-1c9b-485e-9501-5a5005fd82bd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:38.580119 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4c48c16c-1c9b-485e-9501-5a5005fd82bd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:38.580546 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4c48c16c-1c9b-485e-9501-5a5005fd82bd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:38.581215 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4c48c16c-1c9b-485e-9501-5a5005fd82bd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:38.581658 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4c48c16c-1c9b-485e-9501-5a5005fd82bd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:38.582069 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4c48c16c-1c9b-485e-9501-5a5005fd82bd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:38.722275 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-4c48c16c-1c9b-485e-9501-5a5005fd82bd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:38.730817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-4c48c16c-1c9b-485e-9501-5a5005fd82bd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:38.732301 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-4c48c16c-1c9b-485e-9501-5a5005fd82bd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:38.733380 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-4c48c16c-1c9b-485e-9501-5a5005fd82bd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.164166 Aug 12 11:50:38.733938 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 66/125] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:38 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:39.234597 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e0eb190a-eb36-4ee9-88d2-2ce176647b12 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:39.235223 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-e0eb190a-eb36-4ee9-88d2-2ce176647b12 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:39.236891 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-09786a41-dabf-4df6-822d-5e0c74bb8824 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:39.237496 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-09786a41-dabf-4df6-822d-5e0c74bb8824 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:39.241141 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e0eb190a-eb36-4ee9-88d2-2ce176647b12 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:39.241618 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e0eb190a-eb36-4ee9-88d2-2ce176647b12 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:39.242053 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e0eb190a-eb36-4ee9-88d2-2ce176647b12 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:39.242764 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e0eb190a-eb36-4ee9-88d2-2ce176647b12 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:39.243213 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e0eb190a-eb36-4ee9-88d2-2ce176647b12 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:39.243416 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-09786a41-dabf-4df6-822d-5e0c74bb8824 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:39.243638 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e0eb190a-eb36-4ee9-88d2-2ce176647b12 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:39.243885 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-09786a41-dabf-4df6-822d-5e0c74bb8824 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:39.244314 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-09786a41-dabf-4df6-822d-5e0c74bb8824 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:39.244983 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-09786a41-dabf-4df6-822d-5e0c74bb8824 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:39.245428 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-09786a41-dabf-4df6-822d-5e0c74bb8824 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:39.245841 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-09786a41-dabf-4df6-822d-5e0c74bb8824 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:39.432634 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e0eb190a-eb36-4ee9-88d2-2ce176647b12 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:39.436561 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-09786a41-dabf-4df6-822d-5e0c74bb8824 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:39.440267 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e0eb190a-eb36-4ee9-88d2-2ce176647b12 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.209462 Aug 12 11:50:39.440917 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 60/126] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:39 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:39.444264 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-09786a41-dabf-4df6-822d-5e0c74bb8824 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 0.210623 Aug 12 11:50:39.445383 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 67/127] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:39 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:39.456418 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-8d1b0a35-985f-4272-9d33-25a49cbbbb2c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:39.457189 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-423c8e52-2ea6-41bf-9c25-e81281cf23d9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:39.457617 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-8d1b0a35-985f-4272-9d33-25a49cbbbb2c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:39.457831 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-423c8e52-2ea6-41bf-9c25-e81281cf23d9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:39.465528 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8d1b0a35-985f-4272-9d33-25a49cbbbb2c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:39.466338 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8d1b0a35-985f-4272-9d33-25a49cbbbb2c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:39.466447 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-423c8e52-2ea6-41bf-9c25-e81281cf23d9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:39.466895 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-423c8e52-2ea6-41bf-9c25-e81281cf23d9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:39.467058 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8d1b0a35-985f-4272-9d33-25a49cbbbb2c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:39.467721 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-423c8e52-2ea6-41bf-9c25-e81281cf23d9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:39.467834 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8d1b0a35-985f-4272-9d33-25a49cbbbb2c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:39.468175 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8d1b0a35-985f-4272-9d33-25a49cbbbb2c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:39.468595 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8d1b0a35-985f-4272-9d33-25a49cbbbb2c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:39.468781 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-423c8e52-2ea6-41bf-9c25-e81281cf23d9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:39.469533 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-423c8e52-2ea6-41bf-9c25-e81281cf23d9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:39.470205 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-423c8e52-2ea6-41bf-9c25-e81281cf23d9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:39.655069 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-8d1b0a35-985f-4272-9d33-25a49cbbbb2c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:39.662568 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-8d1b0a35-985f-4272-9d33-25a49cbbbb2c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.210350 Aug 12 11:50:39.663255 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 61/128] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:39 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:39.669406 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-423c8e52-2ea6-41bf-9c25-e81281cf23d9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:39.677040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-423c8e52-2ea6-41bf-9c25-e81281cf23d9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1366 microversion: 2.1 time: 0.224349 Aug 12 11:50:39.677595 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 68/129] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:39 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:39.754884 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-c27cb146-b00b-4ae8-8c55-ce2255f8e501 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:39.755486 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-c27cb146-b00b-4ae8-8c55-ce2255f8e501 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:39.762009 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c27cb146-b00b-4ae8-8c55-ce2255f8e501 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:39.762482 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c27cb146-b00b-4ae8-8c55-ce2255f8e501 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:39.762948 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c27cb146-b00b-4ae8-8c55-ce2255f8e501 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:39.763623 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c27cb146-b00b-4ae8-8c55-ce2255f8e501 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:39.764064 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c27cb146-b00b-4ae8-8c55-ce2255f8e501 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:39.764487 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c27cb146-b00b-4ae8-8c55-ce2255f8e501 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:39.898565 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-c27cb146-b00b-4ae8-8c55-ce2255f8e501 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:39.906408 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-c27cb146-b00b-4ae8-8c55-ce2255f8e501 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:39.907885 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-c27cb146-b00b-4ae8-8c55-ce2255f8e501 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:39.909011 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-c27cb146-b00b-4ae8-8c55-ce2255f8e501 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.157893 Aug 12 11:50:39.909562 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 62/130] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:39 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:40.461928 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-c9cedbcb-426d-4251-8bd9-07aeb029cb6a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:40.462536 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-c9cedbcb-426d-4251-8bd9-07aeb029cb6a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:40.464928 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-a1945d5f-b5e2-47f3-8ee9-d141fb6d8784 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:40.465535 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-a1945d5f-b5e2-47f3-8ee9-d141fb6d8784 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:40.468638 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c9cedbcb-426d-4251-8bd9-07aeb029cb6a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:40.469118 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c9cedbcb-426d-4251-8bd9-07aeb029cb6a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:40.469558 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c9cedbcb-426d-4251-8bd9-07aeb029cb6a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:40.470242 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c9cedbcb-426d-4251-8bd9-07aeb029cb6a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:40.470723 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c9cedbcb-426d-4251-8bd9-07aeb029cb6a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:40.471148 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c9cedbcb-426d-4251-8bd9-07aeb029cb6a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:40.471452 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a1945d5f-b5e2-47f3-8ee9-d141fb6d8784 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:40.471934 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a1945d5f-b5e2-47f3-8ee9-d141fb6d8784 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:40.472364 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a1945d5f-b5e2-47f3-8ee9-d141fb6d8784 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:40.473046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a1945d5f-b5e2-47f3-8ee9-d141fb6d8784 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:40.473511 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a1945d5f-b5e2-47f3-8ee9-d141fb6d8784 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:40.473911 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a1945d5f-b5e2-47f3-8ee9-d141fb6d8784 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:40.860128 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-c9cedbcb-426d-4251-8bd9-07aeb029cb6a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:40.864117 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-a1945d5f-b5e2-47f3-8ee9-d141fb6d8784 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:40.868148 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-c9cedbcb-426d-4251-8bd9-07aeb029cb6a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.410569 Aug 12 11:50:40.868796 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 69/131] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:40 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:40.872871 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-a1945d5f-b5e2-47f3-8ee9-d141fb6d8784 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 0.411703 Aug 12 11:50:40.873309 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-0ace5c11-e8ec-493b-a83c-4d11f69e4463 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:40.878759 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 63/132] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:40 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:40.879395 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-0ace5c11-e8ec-493b-a83c-4d11f69e4463 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:40.882978 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0ace5c11-e8ec-493b-a83c-4d11f69e4463 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:40.883570 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0ace5c11-e8ec-493b-a83c-4d11f69e4463 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:40.883946 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-6473ace5-03f6-43d1-a5e6-3d7ff75a3a73 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:40.884198 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0ace5c11-e8ec-493b-a83c-4d11f69e4463 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:40.884545 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-6473ace5-03f6-43d1-a5e6-3d7ff75a3a73 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:40.885076 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0ace5c11-e8ec-493b-a83c-4d11f69e4463 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:40.885637 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0ace5c11-e8ec-493b-a83c-4d11f69e4463 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:40.886167 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0ace5c11-e8ec-493b-a83c-4d11f69e4463 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:40.890329 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6473ace5-03f6-43d1-a5e6-3d7ff75a3a73 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:40.890911 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6473ace5-03f6-43d1-a5e6-3d7ff75a3a73 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:40.891414 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6473ace5-03f6-43d1-a5e6-3d7ff75a3a73 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:40.892173 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6473ace5-03f6-43d1-a5e6-3d7ff75a3a73 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:40.892630 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6473ace5-03f6-43d1-a5e6-3d7ff75a3a73 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:40.893052 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6473ace5-03f6-43d1-a5e6-3d7ff75a3a73 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:41.074153 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-0ace5c11-e8ec-493b-a83c-4d11f69e4463 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:41.081087 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-6473ace5-03f6-43d1-a5e6-3d7ff75a3a73 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:41.082192 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-0ace5c11-e8ec-493b-a83c-4d11f69e4463 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.212441 Aug 12 11:50:41.082968 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 70/133] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:40 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:41.087461 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-f18e341d-febc-4b4b-b0c3-c6a9fb6a3d6b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:41.088137 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-f18e341d-febc-4b4b-b0c3-c6a9fb6a3d6b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:41.092508 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-6473ace5-03f6-43d1-a5e6-3d7ff75a3a73 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1366 microversion: 2.1 time: 0.216341 Aug 12 11:50:41.094133 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f18e341d-febc-4b4b-b0c3-c6a9fb6a3d6b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:41.094640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f18e341d-febc-4b4b-b0c3-c6a9fb6a3d6b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:41.095081 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f18e341d-febc-4b4b-b0c3-c6a9fb6a3d6b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:41.095967 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f18e341d-febc-4b4b-b0c3-c6a9fb6a3d6b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:41.096082 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 64/134] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:40 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:41.096629 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f18e341d-febc-4b4b-b0c3-c6a9fb6a3d6b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:41.097196 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f18e341d-febc-4b4b-b0c3-c6a9fb6a3d6b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:41.224955 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-f18e341d-febc-4b4b-b0c3-c6a9fb6a3d6b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:41.232710 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-f18e341d-febc-4b4b-b0c3-c6a9fb6a3d6b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:41.234207 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-f18e341d-febc-4b4b-b0c3-c6a9fb6a3d6b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:41.235332 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-f18e341d-febc-4b4b-b0c3-c6a9fb6a3d6b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.151547 Aug 12 11:50:41.235881 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 71/135] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:41 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:41.889500 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-67d7b151-ef5f-4d5d-af94-132824b4f676 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:41.890738 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-67d7b151-ef5f-4d5d-af94-132824b4f676 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:41.893030 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-5c5ed34b-51ea-44a4-bfed-6d3143aea5a3 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:41.893635 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-5c5ed34b-51ea-44a4-bfed-6d3143aea5a3 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:41.898598 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-67d7b151-ef5f-4d5d-af94-132824b4f676 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:41.899350 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-67d7b151-ef5f-4d5d-af94-132824b4f676 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:41.899468 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_api:SELECT=100 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:41.900089 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-67d7b151-ef5f-4d5d-af94-132824b4f676 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:41.900825 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5c5ed34b-51ea-44a4-bfed-6d3143aea5a3 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:41.901234 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-67d7b151-ef5f-4d5d-af94-132824b4f676 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:41.901352 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5c5ed34b-51ea-44a4-bfed-6d3143aea5a3 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:41.901719 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5c5ed34b-51ea-44a4-bfed-6d3143aea5a3 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:41.902336 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-67d7b151-ef5f-4d5d-af94-132824b4f676 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:41.902445 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5c5ed34b-51ea-44a4-bfed-6d3143aea5a3 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:41.902870 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5c5ed34b-51ea-44a4-bfed-6d3143aea5a3 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:41.904205 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5c5ed34b-51ea-44a4-bfed-6d3143aea5a3 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:41.904431 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-67d7b151-ef5f-4d5d-af94-132824b4f676 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:42.210171 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-67d7b151-ef5f-4d5d-af94-132824b4f676 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:42.221545 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-67d7b151-ef5f-4d5d-af94-132824b4f676 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.333860 Aug 12 11:50:42.221838 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-5c5ed34b-51ea-44a4-bfed-6d3143aea5a3 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:42.222593 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 65/136] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:41 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:42.230109 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-f046d4c2-30d9-41a7-95aa-608b5b00f106 req-72e91841-8941-441d-9b8f-b464c7a68674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5109a18a-e7ab-4ce9-904b-63c1dfc7197a", "name": "network-vif-plugged", "status": "completed", "tag": "193da7e7-7328-4dc4-bfb7-5c909c304ee1"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:50:42.243470 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-f046d4c2-30d9-41a7-95aa-608b5b00f106 req-72e91841-8941-441d-9b8f-b464c7a68674 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:42.244219 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-f046d4c2-30d9-41a7-95aa-608b5b00f106 req-72e91841-8941-441d-9b8f-b464c7a68674 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:42.245039 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-f046d4c2-30d9-41a7-95aa-608b5b00f106 req-72e91841-8941-441d-9b8f-b464c7a68674 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:42.257222 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-5c5ed34b-51ea-44a4-bfed-6d3143aea5a3 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 0.356450 Aug 12 11:50:42.257928 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 72/137] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:41 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:42.267574 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-8afb7d4a-d4f6-454d-9b77-cba9fdbc3f9d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:42.269411 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-8afb7d4a-d4f6-454d-9b77-cba9fdbc3f9d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:42.275305 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-f046d4c2-30d9-41a7-95aa-608b5b00f106 req-72e91841-8941-441d-9b8f-b464c7a68674 service nova] Creating event network-vif-plugged:193da7e7-7328-4dc4-bfb7-5c909c304ee1 for instance 5109a18a-e7ab-4ce9-904b-63c1dfc7197a on hv-cinder-85282 Aug 12 11:50:42.279175 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8afb7d4a-d4f6-454d-9b77-cba9fdbc3f9d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:42.279739 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8afb7d4a-d4f6-454d-9b77-cba9fdbc3f9d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:42.280172 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8afb7d4a-d4f6-454d-9b77-cba9fdbc3f9d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:42.281606 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8afb7d4a-d4f6-454d-9b77-cba9fdbc3f9d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:42.282068 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8afb7d4a-d4f6-454d-9b77-cba9fdbc3f9d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:42.283310 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8afb7d4a-d4f6-454d-9b77-cba9fdbc3f9d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:42.283612 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-f046d4c2-30d9-41a7-95aa-608b5b00f106 req-72e91841-8941-441d-9b8f-b464c7a68674 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057591 Aug 12 11:50:42.292738 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 66/138] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:50:42.302815 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-0adb5cbb-0d9e-470a-8dc1-3df6afdf6b60 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:42.304059 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-0adb5cbb-0d9e-470a-8dc1-3df6afdf6b60 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:42.314317 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0adb5cbb-0d9e-470a-8dc1-3df6afdf6b60 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:42.314958 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0adb5cbb-0d9e-470a-8dc1-3df6afdf6b60 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:42.315637 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0adb5cbb-0d9e-470a-8dc1-3df6afdf6b60 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:42.316493 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0adb5cbb-0d9e-470a-8dc1-3df6afdf6b60 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:42.316982 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0adb5cbb-0d9e-470a-8dc1-3df6afdf6b60 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:42.317698 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0adb5cbb-0d9e-470a-8dc1-3df6afdf6b60 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:42.537567 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-8afb7d4a-d4f6-454d-9b77-cba9fdbc3f9d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:42.545952 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-0adb5cbb-0d9e-470a-8dc1-3df6afdf6b60 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:42.550579 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-8afb7d4a-d4f6-454d-9b77-cba9fdbc3f9d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.291419 Aug 12 11:50:42.552736 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 73/139] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:42 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:42.554792 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-0adb5cbb-0d9e-470a-8dc1-3df6afdf6b60 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1557 microversion: 2.1 time: 0.260592 Aug 12 11:50:42.555856 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 67/140] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:42 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1557 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:42.564472 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-b2c4fe0c-7f19-4801-b9d5-b5c2952aa32d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:42.564472 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-b2c4fe0c-7f19-4801-b9d5-b5c2952aa32d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:42.569650 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b2c4fe0c-7f19-4801-b9d5-b5c2952aa32d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:42.570132 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b2c4fe0c-7f19-4801-b9d5-b5c2952aa32d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:42.570944 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b2c4fe0c-7f19-4801-b9d5-b5c2952aa32d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:42.571919 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b2c4fe0c-7f19-4801-b9d5-b5c2952aa32d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:42.572546 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b2c4fe0c-7f19-4801-b9d5-b5c2952aa32d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:42.573076 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b2c4fe0c-7f19-4801-b9d5-b5c2952aa32d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:42.576791 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e8ffc941-b63f-4597-b4f5-1eb38d8b0385 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:42.577283 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-e8ffc941-b63f-4597-b4f5-1eb38d8b0385 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:42.583477 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e8ffc941-b63f-4597-b4f5-1eb38d8b0385 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:42.584204 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e8ffc941-b63f-4597-b4f5-1eb38d8b0385 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:42.584668 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e8ffc941-b63f-4597-b4f5-1eb38d8b0385 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:42.585426 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e8ffc941-b63f-4597-b4f5-1eb38d8b0385 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:42.586309 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e8ffc941-b63f-4597-b4f5-1eb38d8b0385 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:42.590763 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e8ffc941-b63f-4597-b4f5-1eb38d8b0385 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:42.721152 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e8ffc941-b63f-4597-b4f5-1eb38d8b0385 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.148471 Aug 12 11:50:42.721692 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 68/141] 10.222.0.42 () {58 vars in 1275 bytes} [Fri Aug 12 11:50:42 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65/os-interface => generated 285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:50:42.747715 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-b2c4fe0c-7f19-4801-b9d5-b5c2952aa32d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:42.755938 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-b2c4fe0c-7f19-4801-b9d5-b5c2952aa32d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:42.758136 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-b2c4fe0c-7f19-4801-b9d5-b5c2952aa32d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:42.759250 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-b2c4fe0c-7f19-4801-b9d5-b5c2952aa32d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.204805 Aug 12 11:50:42.759806 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 74/142] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:42 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:43.242438 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-063469cf-21e5-4cd7-9d8c-86bb1a7361d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:43.243652 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-063469cf-21e5-4cd7-9d8c-86bb1a7361d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:43.260657 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-063469cf-21e5-4cd7-9d8c-86bb1a7361d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:43.261317 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-063469cf-21e5-4cd7-9d8c-86bb1a7361d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:43.261755 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-063469cf-21e5-4cd7-9d8c-86bb1a7361d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:43.262460 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-063469cf-21e5-4cd7-9d8c-86bb1a7361d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:43.267240 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-063469cf-21e5-4cd7-9d8c-86bb1a7361d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:43.267686 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-063469cf-21e5-4cd7-9d8c-86bb1a7361d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:43.270574 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-4c3ed2cb-6dc6-45ce-9cb6-e75a5054021d tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:43.271231 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-4c3ed2cb-6dc6-45ce-9cb6-e75a5054021d tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:43.300818 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4c3ed2cb-6dc6-45ce-9cb6-e75a5054021d tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:43.309052 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4c3ed2cb-6dc6-45ce-9cb6-e75a5054021d tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:43.309793 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4c3ed2cb-6dc6-45ce-9cb6-e75a5054021d tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:43.310764 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4c3ed2cb-6dc6-45ce-9cb6-e75a5054021d tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:43.316414 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4c3ed2cb-6dc6-45ce-9cb6-e75a5054021d tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:43.317188 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4c3ed2cb-6dc6-45ce-9cb6-e75a5054021d tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:43.919211 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-063469cf-21e5-4cd7-9d8c-86bb1a7361d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:43.925019 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-063469cf-21e5-4cd7-9d8c-86bb1a7361d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.686981 Aug 12 11:50:43.925583 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 69/143] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:43 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:43.939616 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-bd0a2ff6-1659-4e9c-b85d-64aeabb15b6a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:43.940600 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-bd0a2ff6-1659-4e9c-b85d-64aeabb15b6a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:43.957966 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bd0a2ff6-1659-4e9c-b85d-64aeabb15b6a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:43.958558 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bd0a2ff6-1659-4e9c-b85d-64aeabb15b6a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:43.958901 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bd0a2ff6-1659-4e9c-b85d-64aeabb15b6a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:43.960224 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bd0a2ff6-1659-4e9c-b85d-64aeabb15b6a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:43.960833 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bd0a2ff6-1659-4e9c-b85d-64aeabb15b6a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:43.961401 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bd0a2ff6-1659-4e9c-b85d-64aeabb15b6a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:44.089487 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-4c3ed2cb-6dc6-45ce-9cb6-e75a5054021d tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:44.100254 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-4c3ed2cb-6dc6-45ce-9cb6-e75a5054021d tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 0.835747 Aug 12 11:50:44.100849 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 75/144] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:43 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:44.119646 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-094977c5-05b9-4a76-bf01-9df684d21343 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:44.120470 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-094977c5-05b9-4a76-bf01-9df684d21343 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:44.127937 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-094977c5-05b9-4a76-bf01-9df684d21343 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:44.129179 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-094977c5-05b9-4a76-bf01-9df684d21343 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:44.130396 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-094977c5-05b9-4a76-bf01-9df684d21343 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:44.133044 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-094977c5-05b9-4a76-bf01-9df684d21343 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:44.133782 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-094977c5-05b9-4a76-bf01-9df684d21343 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:44.134562 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-094977c5-05b9-4a76-bf01-9df684d21343 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:44.328923 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-bd0a2ff6-1659-4e9c-b85d-64aeabb15b6a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:44.339837 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-bd0a2ff6-1659-4e9c-b85d-64aeabb15b6a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.403991 Aug 12 11:50:44.341160 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 70/145] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:43 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:44.345802 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-d8144f8b-d737-4195-a984-e83eba42235d req-3c1bf003-7e8f-495c-bfcf-bc94882fb6e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17168892-79e0-4148-94f8-9034d13d060c", "name": "network-vif-plugged", "status": "completed", "tag": "d7d8ffb8-c0a5-4afc-b4c5-f929667db09c"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:50:44.351778 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_api:SELECT=100 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:44.357632 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-d8144f8b-d737-4195-a984-e83eba42235d req-3c1bf003-7e8f-495c-bfcf-bc94882fb6e9 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:44.358339 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-d8144f8b-d737-4195-a984-e83eba42235d req-3c1bf003-7e8f-495c-bfcf-bc94882fb6e9 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:44.358991 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-d8144f8b-d737-4195-a984-e83eba42235d req-3c1bf003-7e8f-495c-bfcf-bc94882fb6e9 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:44.371627 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-d8144f8b-d737-4195-a984-e83eba42235d req-3c1bf003-7e8f-495c-bfcf-bc94882fb6e9 service nova] Creating event network-vif-plugged:d7d8ffb8-c0a5-4afc-b4c5-f929667db09c for instance 17168892-79e0-4148-94f8-9034d13d060c on hv-cinder-85282 Aug 12 11:50:44.377089 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-d8144f8b-d737-4195-a984-e83eba42235d req-3c1bf003-7e8f-495c-bfcf-bc94882fb6e9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034490 Aug 12 11:50:44.377874 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 71/146] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:50:44.410522 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-094977c5-05b9-4a76-bf01-9df684d21343 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:44.419876 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-094977c5-05b9-4a76-bf01-9df684d21343 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:44.421290 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-094977c5-05b9-4a76-bf01-9df684d21343 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:44.422800 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-094977c5-05b9-4a76-bf01-9df684d21343 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.310461 Aug 12 11:50:44.423371 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 76/147] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:44 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:44.682094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-58d1bfb4-672b-4d74-9714-109574c54880 req-81572f3f-dadb-4be6-9444-a0caf22f16ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4ed98fc-5acc-42ec-9b95-86fc33117c65", "tag": "4dbda732-75b7-4922-aed4-c2911cb6c8b5"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:50:44.693012 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-58d1bfb4-672b-4d74-9714-109574c54880 req-81572f3f-dadb-4be6-9444-a0caf22f16ba service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:44.693763 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-58d1bfb4-672b-4d74-9714-109574c54880 req-81572f3f-dadb-4be6-9444-a0caf22f16ba service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:44.694367 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-58d1bfb4-672b-4d74-9714-109574c54880 req-81572f3f-dadb-4be6-9444-a0caf22f16ba service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:44.707564 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-58d1bfb4-672b-4d74-9714-109574c54880 req-81572f3f-dadb-4be6-9444-a0caf22f16ba service nova] Creating event network-changed:4dbda732-75b7-4922-aed4-c2911cb6c8b5 for instance d4ed98fc-5acc-42ec-9b95-86fc33117c65 on hv-cinder-85282 Aug 12 11:50:44.712825 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-58d1bfb4-672b-4d74-9714-109574c54880 req-81572f3f-dadb-4be6-9444-a0caf22f16ba service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036958 Aug 12 11:50:44.713500 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 72/148] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:50:44.946314 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-8dc2a7a9-03e4-4500-b2df-7ac3bc43f85d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:44.947031 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-8dc2a7a9-03e4-4500-b2df-7ac3bc43f85d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:44.954110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8dc2a7a9-03e4-4500-b2df-7ac3bc43f85d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:44.956468 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8dc2a7a9-03e4-4500-b2df-7ac3bc43f85d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:44.956995 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8dc2a7a9-03e4-4500-b2df-7ac3bc43f85d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:44.957765 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8dc2a7a9-03e4-4500-b2df-7ac3bc43f85d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:44.958275 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8dc2a7a9-03e4-4500-b2df-7ac3bc43f85d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:44.958884 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8dc2a7a9-03e4-4500-b2df-7ac3bc43f85d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:45.124690 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-812ad7a5-7307-40fd-8ace-40264ba7e7a8 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:45.125394 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-812ad7a5-7307-40fd-8ace-40264ba7e7a8 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:45.135024 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-8dc2a7a9-03e4-4500-b2df-7ac3bc43f85d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:45.143317 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-812ad7a5-7307-40fd-8ace-40264ba7e7a8 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:45.143802 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-812ad7a5-7307-40fd-8ace-40264ba7e7a8 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:45.144954 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-8dc2a7a9-03e4-4500-b2df-7ac3bc43f85d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.202641 Aug 12 11:50:45.145532 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 77/149] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:44 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:45.145800 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-812ad7a5-7307-40fd-8ace-40264ba7e7a8 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:45.147429 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-812ad7a5-7307-40fd-8ace-40264ba7e7a8 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:45.147897 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-812ad7a5-7307-40fd-8ace-40264ba7e7a8 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:45.148353 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-812ad7a5-7307-40fd-8ace-40264ba7e7a8 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:45.318016 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-812ad7a5-7307-40fd-8ace-40264ba7e7a8 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:45.327452 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-812ad7a5-7307-40fd-8ace-40264ba7e7a8 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 0.206845 Aug 12 11:50:45.335326 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 73/150] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:45 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:45.368887 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-8e395f52-38f2-4f84-8c13-d1e3dfbc39f7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:45.369986 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-8e395f52-38f2-4f84-8c13-d1e3dfbc39f7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:45.379666 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8e395f52-38f2-4f84-8c13-d1e3dfbc39f7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:45.380156 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8e395f52-38f2-4f84-8c13-d1e3dfbc39f7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:45.380734 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8e395f52-38f2-4f84-8c13-d1e3dfbc39f7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:45.382115 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8e395f52-38f2-4f84-8c13-d1e3dfbc39f7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:45.382595 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8e395f52-38f2-4f84-8c13-d1e3dfbc39f7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:45.384124 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8e395f52-38f2-4f84-8c13-d1e3dfbc39f7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:45.388593 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=100 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:45.445829 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-a7027e41-a0d1-4d45-af36-7e00e6d12a53 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:45.446580 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-a7027e41-a0d1-4d45-af36-7e00e6d12a53 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:45.455157 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a7027e41-a0d1-4d45-af36-7e00e6d12a53 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:45.456485 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a7027e41-a0d1-4d45-af36-7e00e6d12a53 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:45.457080 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a7027e41-a0d1-4d45-af36-7e00e6d12a53 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:45.459030 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a7027e41-a0d1-4d45-af36-7e00e6d12a53 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:45.460079 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a7027e41-a0d1-4d45-af36-7e00e6d12a53 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:45.460519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a7027e41-a0d1-4d45-af36-7e00e6d12a53 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:45.586536 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-8e395f52-38f2-4f84-8c13-d1e3dfbc39f7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:45.601323 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-8e395f52-38f2-4f84-8c13-d1e3dfbc39f7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.237263 Aug 12 11:50:45.604186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 78/151] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:45 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:45.659170 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-a7027e41-a0d1-4d45-af36-7e00e6d12a53 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:45.668177 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-a7027e41-a0d1-4d45-af36-7e00e6d12a53 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:45.669824 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-a7027e41-a0d1-4d45-af36-7e00e6d12a53 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:45.671156 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-a7027e41-a0d1-4d45-af36-7e00e6d12a53 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.229720 Aug 12 11:50:45.690047 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 74/152] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:45 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:46.168446 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-9b8cf275-e979-45af-b25d-60e73605353c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:46.169290 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-9b8cf275-e979-45af-b25d-60e73605353c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:46.177341 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9b8cf275-e979-45af-b25d-60e73605353c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:46.177829 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9b8cf275-e979-45af-b25d-60e73605353c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:46.178878 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9b8cf275-e979-45af-b25d-60e73605353c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:46.179575 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9b8cf275-e979-45af-b25d-60e73605353c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:46.180024 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9b8cf275-e979-45af-b25d-60e73605353c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:46.180447 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9b8cf275-e979-45af-b25d-60e73605353c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:46.335693 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-9b8cf275-e979-45af-b25d-60e73605353c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:46.343656 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-9b8cf275-e979-45af-b25d-60e73605353c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.181969 Aug 12 11:50:46.344227 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 79/153] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:46 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:46.364592 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-b427999a-9ae8-490d-a621-6c58e4119d06 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:46.368295 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-b427999a-9ae8-490d-a621-6c58e4119d06 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:46.374804 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b427999a-9ae8-490d-a621-6c58e4119d06 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:46.375300 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b427999a-9ae8-490d-a621-6c58e4119d06 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:46.375743 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b427999a-9ae8-490d-a621-6c58e4119d06 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:46.376443 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b427999a-9ae8-490d-a621-6c58e4119d06 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:46.376903 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b427999a-9ae8-490d-a621-6c58e4119d06 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:46.377330 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b427999a-9ae8-490d-a621-6c58e4119d06 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:46.625418 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-f8e69c20-af57-4f02-8c82-f75df1a3dad2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:46.626329 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-f8e69c20-af57-4f02-8c82-f75df1a3dad2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:46.633506 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f8e69c20-af57-4f02-8c82-f75df1a3dad2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:46.634175 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f8e69c20-af57-4f02-8c82-f75df1a3dad2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:46.634743 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f8e69c20-af57-4f02-8c82-f75df1a3dad2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:46.635560 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f8e69c20-af57-4f02-8c82-f75df1a3dad2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:46.636122 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f8e69c20-af57-4f02-8c82-f75df1a3dad2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:46.636812 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f8e69c20-af57-4f02-8c82-f75df1a3dad2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:46.827573 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-b427999a-9ae8-490d-a621-6c58e4119d06 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:46.837716 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-b427999a-9ae8-490d-a621-6c58e4119d06 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 0.477128 Aug 12 11:50:46.839027 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 75/154] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:46 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:46.843728 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-3ac64d44-ce21-46f6-b8ae-345f7bffb0c3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:46.844460 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-3ac64d44-ce21-46f6-b8ae-345f7bffb0c3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:46.851847 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3ac64d44-ce21-46f6-b8ae-345f7bffb0c3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:46.852585 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3ac64d44-ce21-46f6-b8ae-345f7bffb0c3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:46.853093 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3ac64d44-ce21-46f6-b8ae-345f7bffb0c3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:46.853870 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3ac64d44-ce21-46f6-b8ae-345f7bffb0c3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:46.854449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3ac64d44-ce21-46f6-b8ae-345f7bffb0c3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:46.855148 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3ac64d44-ce21-46f6-b8ae-345f7bffb0c3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:46.876971 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-f8e69c20-af57-4f02-8c82-f75df1a3dad2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:46.886976 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-f8e69c20-af57-4f02-8c82-f75df1a3dad2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.265411 Aug 12 11:50:46.891430 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 80/155] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:46 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:47.020116 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-3ac64d44-ce21-46f6-b8ae-345f7bffb0c3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:47.031744 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-3ac64d44-ce21-46f6-b8ae-345f7bffb0c3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:47.033290 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-3ac64d44-ce21-46f6-b8ae-345f7bffb0c3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:47.034635 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-3ac64d44-ce21-46f6-b8ae-345f7bffb0c3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.194451 Aug 12 11:50:47.035344 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 76/156] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:46 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:47.373665 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-aae485c4-6678-4212-9d70-9d6c0fc53b9d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:47.373665 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-aae485c4-6678-4212-9d70-9d6c0fc53b9d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:47.379074 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-aae485c4-6678-4212-9d70-9d6c0fc53b9d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:47.381189 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-aae485c4-6678-4212-9d70-9d6c0fc53b9d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:47.382458 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-aae485c4-6678-4212-9d70-9d6c0fc53b9d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:47.385389 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-aae485c4-6678-4212-9d70-9d6c0fc53b9d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:47.385997 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-aae485c4-6678-4212-9d70-9d6c0fc53b9d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:47.386948 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-aae485c4-6678-4212-9d70-9d6c0fc53b9d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:47.542184 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-aae485c4-6678-4212-9d70-9d6c0fc53b9d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:47.554438 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-aae485c4-6678-4212-9d70-9d6c0fc53b9d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.192034 Aug 12 11:50:47.557308 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 81/157] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:47 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:47.859247 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e5abc1aa-9194-4625-a865-44da737e2984 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:47.859730 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-e5abc1aa-9194-4625-a865-44da737e2984 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:47.868051 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e5abc1aa-9194-4625-a865-44da737e2984 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:47.868539 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e5abc1aa-9194-4625-a865-44da737e2984 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:47.868974 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e5abc1aa-9194-4625-a865-44da737e2984 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:47.869674 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e5abc1aa-9194-4625-a865-44da737e2984 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:47.870127 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e5abc1aa-9194-4625-a865-44da737e2984 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:47.870550 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e5abc1aa-9194-4625-a865-44da737e2984 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:47.912650 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-9e90c7dc-f4a0-4d24-b163-211fea3e755f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:47.919019 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-9e90c7dc-f4a0-4d24-b163-211fea3e755f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:47.926278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9e90c7dc-f4a0-4d24-b163-211fea3e755f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:47.927297 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9e90c7dc-f4a0-4d24-b163-211fea3e755f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:47.927857 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9e90c7dc-f4a0-4d24-b163-211fea3e755f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:47.930941 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9e90c7dc-f4a0-4d24-b163-211fea3e755f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:47.932164 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9e90c7dc-f4a0-4d24-b163-211fea3e755f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:47.938463 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9e90c7dc-f4a0-4d24-b163-211fea3e755f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:48.069984 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e5abc1aa-9194-4625-a865-44da737e2984 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:48.078683 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e5abc1aa-9194-4625-a865-44da737e2984 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 0.223235 Aug 12 11:50:48.079560 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 77/158] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:47 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:48.085256 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-286de333-05fc-4d8c-85f5-eea4ec1f1623 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:48.086242 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-286de333-05fc-4d8c-85f5-eea4ec1f1623 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:48.092507 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-286de333-05fc-4d8c-85f5-eea4ec1f1623 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:48.093503 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-286de333-05fc-4d8c-85f5-eea4ec1f1623 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:48.094156 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-286de333-05fc-4d8c-85f5-eea4ec1f1623 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:48.095358 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-286de333-05fc-4d8c-85f5-eea4ec1f1623 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:48.096146 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-286de333-05fc-4d8c-85f5-eea4ec1f1623 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:48.096789 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-286de333-05fc-4d8c-85f5-eea4ec1f1623 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:48.124538 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=100 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:48.138756 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-9e90c7dc-f4a0-4d24-b163-211fea3e755f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:48.149004 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-9e90c7dc-f4a0-4d24-b163-211fea3e755f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.244666 Aug 12 11:50:48.150080 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 82/159] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:47 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:48.267963 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-286de333-05fc-4d8c-85f5-eea4ec1f1623 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:48.278653 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-286de333-05fc-4d8c-85f5-eea4ec1f1623 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:48.281423 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-286de333-05fc-4d8c-85f5-eea4ec1f1623 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:48.282990 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-286de333-05fc-4d8c-85f5-eea4ec1f1623 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.201338 Aug 12 11:50:48.301748 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 78/160] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:48 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:48.580664 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-0af33a6b-4d69-4d11-b864-8e971ff5ca04 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:48.581451 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-0af33a6b-4d69-4d11-b864-8e971ff5ca04 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:48.588742 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0af33a6b-4d69-4d11-b864-8e971ff5ca04 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:48.589703 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0af33a6b-4d69-4d11-b864-8e971ff5ca04 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:48.590220 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0af33a6b-4d69-4d11-b864-8e971ff5ca04 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:48.591060 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0af33a6b-4d69-4d11-b864-8e971ff5ca04 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:48.591587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0af33a6b-4d69-4d11-b864-8e971ff5ca04 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:48.592077 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0af33a6b-4d69-4d11-b864-8e971ff5ca04 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:48.848230 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-0af33a6b-4d69-4d11-b864-8e971ff5ca04 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:48.857793 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-0af33a6b-4d69-4d11-b864-8e971ff5ca04 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.282058 Aug 12 11:50:48.858370 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 83/161] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:48 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:49.099355 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d232dd08-f47f-4ba6-917b-4be4e17bfc78 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:49.100013 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d232dd08-f47f-4ba6-917b-4be4e17bfc78 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:49.105787 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d232dd08-f47f-4ba6-917b-4be4e17bfc78 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:49.106270 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d232dd08-f47f-4ba6-917b-4be4e17bfc78 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:49.106744 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d232dd08-f47f-4ba6-917b-4be4e17bfc78 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:49.107432 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d232dd08-f47f-4ba6-917b-4be4e17bfc78 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:49.107886 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d232dd08-f47f-4ba6-917b-4be4e17bfc78 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:49.108308 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d232dd08-f47f-4ba6-917b-4be4e17bfc78 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:49.172757 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-ac1e9591-17de-48b3-a5e7-fe908bbd0f8c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:49.173371 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-ac1e9591-17de-48b3-a5e7-fe908bbd0f8c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:49.180098 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ac1e9591-17de-48b3-a5e7-fe908bbd0f8c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:49.180098 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ac1e9591-17de-48b3-a5e7-fe908bbd0f8c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:49.180878 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ac1e9591-17de-48b3-a5e7-fe908bbd0f8c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:49.181587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ac1e9591-17de-48b3-a5e7-fe908bbd0f8c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:49.182089 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ac1e9591-17de-48b3-a5e7-fe908bbd0f8c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:49.182582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ac1e9591-17de-48b3-a5e7-fe908bbd0f8c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:49.319661 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d232dd08-f47f-4ba6-917b-4be4e17bfc78 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:49.329399 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-d232dd08-f47f-4ba6-917b-4be4e17bfc78 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 0.233794 Aug 12 11:50:49.330699 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 79/162] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:49 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:49.336575 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-2f1ab28e-1be2-465e-bb06-4a612bd4732d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:49.337648 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-2f1ab28e-1be2-465e-bb06-4a612bd4732d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:49.344796 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2f1ab28e-1be2-465e-bb06-4a612bd4732d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:49.345641 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2f1ab28e-1be2-465e-bb06-4a612bd4732d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:49.346281 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2f1ab28e-1be2-465e-bb06-4a612bd4732d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:49.347218 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2f1ab28e-1be2-465e-bb06-4a612bd4732d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:49.348391 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2f1ab28e-1be2-465e-bb06-4a612bd4732d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:49.348989 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2f1ab28e-1be2-465e-bb06-4a612bd4732d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:49.388536 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-ac1e9591-17de-48b3-a5e7-fe908bbd0f8c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:49.413915 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-ac1e9591-17de-48b3-a5e7-fe908bbd0f8c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.245015 Aug 12 11:50:49.417768 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 84/163] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:49 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:49.516456 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-5955e8f6-82e4-4445-a1ec-f33455872714 req-56d1269c-4b23-4b72-8e60-6460499a443f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712bb3a1-789a-442f-8d59-a635f0896531", "name": "network-vif-plugged", "status": "completed", "tag": "0a1aa4d3-f810-4d8a-b28b-30a0d82ce0c9"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:50:49.546365 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-5955e8f6-82e4-4445-a1ec-f33455872714 req-56d1269c-4b23-4b72-8e60-6460499a443f service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:49.547129 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-5955e8f6-82e4-4445-a1ec-f33455872714 req-56d1269c-4b23-4b72-8e60-6460499a443f service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:49.549986 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-5955e8f6-82e4-4445-a1ec-f33455872714 req-56d1269c-4b23-4b72-8e60-6460499a443f service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:49.573978 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-5955e8f6-82e4-4445-a1ec-f33455872714 req-56d1269c-4b23-4b72-8e60-6460499a443f service nova] Creating event network-vif-plugged:0a1aa4d3-f810-4d8a-b28b-30a0d82ce0c9 for instance 712bb3a1-789a-442f-8d59-a635f0896531 on hv-cinder-85282 Aug 12 11:50:49.592546 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-5955e8f6-82e4-4445-a1ec-f33455872714 req-56d1269c-4b23-4b72-8e60-6460499a443f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080679 Aug 12 11:50:49.605984 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 85/164] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:50:49.683240 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-2f1ab28e-1be2-465e-bb06-4a612bd4732d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:49.692193 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-2f1ab28e-1be2-465e-bb06-4a612bd4732d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:49.696298 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-2f1ab28e-1be2-465e-bb06-4a612bd4732d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:49.704292 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-2f1ab28e-1be2-465e-bb06-4a612bd4732d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.372209 Aug 12 11:50:49.705127 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 80/165] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:49 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:49.879682 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-78e71c0f-ad42-424e-9c0c-167140b303fd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:49.880580 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-78e71c0f-ad42-424e-9c0c-167140b303fd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:49.890053 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-78e71c0f-ad42-424e-9c0c-167140b303fd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:49.890922 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-78e71c0f-ad42-424e-9c0c-167140b303fd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:49.891599 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-78e71c0f-ad42-424e-9c0c-167140b303fd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:49.896406 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-78e71c0f-ad42-424e-9c0c-167140b303fd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:49.897225 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-78e71c0f-ad42-424e-9c0c-167140b303fd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:49.897746 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-78e71c0f-ad42-424e-9c0c-167140b303fd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:50.056479 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-101d95e4-f04e-43ef-98d8-bf4ec6ecb64f tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1195642500", "imageRef": "2887ca5b-6aa2-4cc4-a2be-9322a733fc6d", "flavorRef": "452"}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:50:50.074794 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-78e71c0f-ad42-424e-9c0c-167140b303fd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:50.086374 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-78e71c0f-ad42-424e-9c0c-167140b303fd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.211637 Aug 12 11:50:50.087511 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 86/166] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:49 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:50.132760 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.network.neutron [None req-101d95e4-f04e-43ef-98d8-bf4ec6ecb64f tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] validate_networks() for None {{(pid=132282) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 11:50:50.349592 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-998942f8-5220-4298-8ddf-405eabf0153f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:50.350420 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-998942f8-5220-4298-8ddf-405eabf0153f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:50.357359 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-998942f8-5220-4298-8ddf-405eabf0153f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:50.357858 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-998942f8-5220-4298-8ddf-405eabf0153f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:50.358274 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-998942f8-5220-4298-8ddf-405eabf0153f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:50.359003 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-998942f8-5220-4298-8ddf-405eabf0153f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:50.359714 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-998942f8-5220-4298-8ddf-405eabf0153f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:50.359895 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-998942f8-5220-4298-8ddf-405eabf0153f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:50.448444 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-101d95e4-f04e-43ef-98d8-bf4ec6ecb64f tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Flavor limits 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 11:50:50.448796 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-101d95e4-f04e-43ef-98d8-bf4ec6ecb64f tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Image limits 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 11:50:50.449732 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-101d95e4-f04e-43ef-98d8-bf4ec6ecb64f tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Flavor pref 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 11:50:50.450266 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-101d95e4-f04e-43ef-98d8-bf4ec6ecb64f tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Image pref 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 11:50:50.451021 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-101d95e4-f04e-43ef-98d8-bf4ec6ecb64f tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 11:50:50.460560 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-101d95e4-f04e-43ef-98d8-bf4ec6ecb64f tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:50.461039 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-101d95e4-f04e-43ef-98d8-bf4ec6ecb64f tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:50.461474 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-101d95e4-f04e-43ef-98d8-bf4ec6ecb64f tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:50.462193 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-101d95e4-f04e-43ef-98d8-bf4ec6ecb64f tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:50.462796 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-101d95e4-f04e-43ef-98d8-bf4ec6ecb64f tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:50.463225 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-101d95e4-f04e-43ef-98d8-bf4ec6ecb64f tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:50.485980 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-101d95e4-f04e-43ef-98d8-bf4ec6ecb64f tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Getting quotas for project 3c5b4b400190480aacaa5d0f28aff646. Resources: {'instances', 'ram', 'cores'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:50:50.491267 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-101d95e4-f04e-43ef-98d8-bf4ec6ecb64f tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Getting quotas for user ac0b8111307e47c4acc860603f84c297 and project 3c5b4b400190480aacaa5d0f28aff646. Resources: {'instances', 'ram', 'cores'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:50:50.504594 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-101d95e4-f04e-43ef-98d8-bf4ec6ecb64f tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Going to run 1 instances... {{(pid=132282) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 11:50:50.507638 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-101d95e4-f04e-43ef-98d8-bf4ec6ecb64f tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2887ca5b-6aa2-4cc4-a2be-9322a733fc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132282) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 11:50:50.522280 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-998942f8-5220-4298-8ddf-405eabf0153f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:50.538009 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-998942f8-5220-4298-8ddf-405eabf0153f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 0.191957 Aug 12 11:50:50.539486 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 87/167] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:50 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:50.544692 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-8be81c3c-3da5-4e54-9efd-330f022d8101 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:50.545789 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-8be81c3c-3da5-4e54-9efd-330f022d8101 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:50.551866 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8be81c3c-3da5-4e54-9efd-330f022d8101 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:50.552337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8be81c3c-3da5-4e54-9efd-330f022d8101 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:50.552996 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8be81c3c-3da5-4e54-9efd-330f022d8101 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:50.554175 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8be81c3c-3da5-4e54-9efd-330f022d8101 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:50.554662 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8be81c3c-3da5-4e54-9efd-330f022d8101 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:50.555233 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8be81c3c-3da5-4e54-9efd-330f022d8101 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:50.567631 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-101d95e4-f04e-43ef-98d8-bf4ec6ecb64f tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.515523 Aug 12 11:50:50.568260 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 81/168] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Aug 12 11:50:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 11:50:50.583435 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-610590e3-6bdd-4a7f-b3ea-7cb0bc4952cc tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:50.584296 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-610590e3-6bdd-4a7f-b3ea-7cb0bc4952cc tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:50.670189 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-610590e3-6bdd-4a7f-b3ea-7cb0bc4952cc tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:50.682077 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-610590e3-6bdd-4a7f-b3ea-7cb0bc4952cc tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1215 microversion: 2.1 time: 0.102304 Aug 12 11:50:50.695935 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 82/169] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:50 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1215 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:50.728632 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-8be81c3c-3da5-4e54-9efd-330f022d8101 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:50.732081 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-58f8ea7a-5246-4696-9c3c-7a9c9590eed1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:50.732873 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-58f8ea7a-5246-4696-9c3c-7a9c9590eed1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:50.738250 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-8be81c3c-3da5-4e54-9efd-330f022d8101 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.197075 Aug 12 11:50:50.739373 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-58f8ea7a-5246-4696-9c3c-7a9c9590eed1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:50.739578 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 88/170] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:50 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:50.739908 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-58f8ea7a-5246-4696-9c3c-7a9c9590eed1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:50.740301 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-58f8ea7a-5246-4696-9c3c-7a9c9590eed1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:50.741616 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-58f8ea7a-5246-4696-9c3c-7a9c9590eed1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:50.742061 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-58f8ea7a-5246-4696-9c3c-7a9c9590eed1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:50.742473 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-58f8ea7a-5246-4696-9c3c-7a9c9590eed1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:50.910423 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-58f8ea7a-5246-4696-9c3c-7a9c9590eed1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:50.923047 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-58f8ea7a-5246-4696-9c3c-7a9c9590eed1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:50.925301 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-58f8ea7a-5246-4696-9c3c-7a9c9590eed1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:50.926417 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-58f8ea7a-5246-4696-9c3c-7a9c9590eed1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.198884 Aug 12 11:50:50.934394 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 83/171] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:50 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:51.107199 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-a75b1b38-2ce5-4528-9129-7e7c71aaa49f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:51.107804 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-a75b1b38-2ce5-4528-9129-7e7c71aaa49f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:51.115207 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a75b1b38-2ce5-4528-9129-7e7c71aaa49f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:51.115866 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a75b1b38-2ce5-4528-9129-7e7c71aaa49f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:51.116423 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a75b1b38-2ce5-4528-9129-7e7c71aaa49f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:51.117291 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a75b1b38-2ce5-4528-9129-7e7c71aaa49f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:51.117830 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a75b1b38-2ce5-4528-9129-7e7c71aaa49f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:51.118343 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a75b1b38-2ce5-4528-9129-7e7c71aaa49f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:51.251408 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-a75b1b38-2ce5-4528-9129-7e7c71aaa49f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:51.260071 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-a75b1b38-2ce5-4528-9129-7e7c71aaa49f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.156571 Aug 12 11:50:51.260644 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 89/172] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:51 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:51.561029 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-98d8d9da-ce49-4cfe-87e0-6e75269e51bc tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:51.561708 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-98d8d9da-ce49-4cfe-87e0-6e75269e51bc tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:51.567572 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-98d8d9da-ce49-4cfe-87e0-6e75269e51bc tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:51.568047 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-98d8d9da-ce49-4cfe-87e0-6e75269e51bc tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:51.568507 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-98d8d9da-ce49-4cfe-87e0-6e75269e51bc tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:51.569233 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-98d8d9da-ce49-4cfe-87e0-6e75269e51bc tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:51.569689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-98d8d9da-ce49-4cfe-87e0-6e75269e51bc tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:51.570177 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-98d8d9da-ce49-4cfe-87e0-6e75269e51bc tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:51.625462 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-0251e661-dcdb-4a11-9014-235f12c02d67 req-27462300-a5fd-47e9-bb85-5c98d9add7fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dba7589-a4cf-4842-953b-0218eae4d3db", "name": "network-vif-plugged", "status": "completed", "tag": "e1b3cbaf-769e-41d6-b51a-8e930b076512"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:50:51.635990 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-0251e661-dcdb-4a11-9014-235f12c02d67 req-27462300-a5fd-47e9-bb85-5c98d9add7fb service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:51.636455 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-0251e661-dcdb-4a11-9014-235f12c02d67 req-27462300-a5fd-47e9-bb85-5c98d9add7fb service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:51.636879 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-0251e661-dcdb-4a11-9014-235f12c02d67 req-27462300-a5fd-47e9-bb85-5c98d9add7fb service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:51.653246 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-0251e661-dcdb-4a11-9014-235f12c02d67 req-27462300-a5fd-47e9-bb85-5c98d9add7fb service nova] Creating event network-vif-plugged:e1b3cbaf-769e-41d6-b51a-8e930b076512 for instance 6dba7589-a4cf-4842-953b-0218eae4d3db on hv-cinder-85282 Aug 12 11:50:51.658330 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-0251e661-dcdb-4a11-9014-235f12c02d67 req-27462300-a5fd-47e9-bb85-5c98d9add7fb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036800 Aug 12 11:50:51.659132 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 90/173] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:50:51.704590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-6d19e2ed-71e0-4c8f-814c-66610e97f471 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:51.705199 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-98d8d9da-ce49-4cfe-87e0-6e75269e51bc tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:51.705338 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-6d19e2ed-71e0-4c8f-814c-66610e97f471 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:51.711548 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6d19e2ed-71e0-4c8f-814c-66610e97f471 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:51.712099 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6d19e2ed-71e0-4c8f-814c-66610e97f471 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:51.712646 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6d19e2ed-71e0-4c8f-814c-66610e97f471 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:51.713194 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-98d8d9da-ce49-4cfe-87e0-6e75269e51bc tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 0.156524 Aug 12 11:50:51.713323 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6d19e2ed-71e0-4c8f-814c-66610e97f471 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:51.713772 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6d19e2ed-71e0-4c8f-814c-66610e97f471 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:51.714021 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 84/174] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:51 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:51.714188 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6d19e2ed-71e0-4c8f-814c-66610e97f471 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:51.760386 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-0a542fd9-9287-4c88-92e4-9ad4bb76009b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:51.761062 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-0a542fd9-9287-4c88-92e4-9ad4bb76009b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:51.766886 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0a542fd9-9287-4c88-92e4-9ad4bb76009b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:51.767448 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0a542fd9-9287-4c88-92e4-9ad4bb76009b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:51.767944 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0a542fd9-9287-4c88-92e4-9ad4bb76009b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:51.768691 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0a542fd9-9287-4c88-92e4-9ad4bb76009b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:51.769139 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0a542fd9-9287-4c88-92e4-9ad4bb76009b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:51.769563 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0a542fd9-9287-4c88-92e4-9ad4bb76009b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:51.777743 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-6d19e2ed-71e0-4c8f-814c-66610e97f471 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:51.785466 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-6d19e2ed-71e0-4c8f-814c-66610e97f471 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1219 microversion: 2.1 time: 0.085049 Aug 12 11:50:51.786104 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 91/175] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:51 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:51.901324 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-0a542fd9-9287-4c88-92e4-9ad4bb76009b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:51.908670 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-0a542fd9-9287-4c88-92e4-9ad4bb76009b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.152888 Aug 12 11:50:51.909241 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 85/176] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:51 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:51.948163 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-0909fbf6-7b42-4269-8fc6-c1acc294ddbc tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:51.948757 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-0909fbf6-7b42-4269-8fc6-c1acc294ddbc tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:51.954596 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0909fbf6-7b42-4269-8fc6-c1acc294ddbc tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:51.955146 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0909fbf6-7b42-4269-8fc6-c1acc294ddbc tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:51.955530 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0909fbf6-7b42-4269-8fc6-c1acc294ddbc tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:51.956205 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0909fbf6-7b42-4269-8fc6-c1acc294ddbc tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:51.956645 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0909fbf6-7b42-4269-8fc6-c1acc294ddbc tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:51.957052 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0909fbf6-7b42-4269-8fc6-c1acc294ddbc tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:52.087875 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-0909fbf6-7b42-4269-8fc6-c1acc294ddbc tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:52.096073 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-0909fbf6-7b42-4269-8fc6-c1acc294ddbc tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:52.097545 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-0909fbf6-7b42-4269-8fc6-c1acc294ddbc tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:52.098854 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-0909fbf6-7b42-4269-8fc6-c1acc294ddbc tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.154471 Aug 12 11:50:52.099405 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 92/177] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:51 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:52.280953 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-5c7b25fe-f134-4fb1-a36b-91437e2b92da tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:52.281559 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-5c7b25fe-f134-4fb1-a36b-91437e2b92da tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:52.287575 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5c7b25fe-f134-4fb1-a36b-91437e2b92da tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:52.288059 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5c7b25fe-f134-4fb1-a36b-91437e2b92da tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:52.288492 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5c7b25fe-f134-4fb1-a36b-91437e2b92da tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:52.291170 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5c7b25fe-f134-4fb1-a36b-91437e2b92da tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:52.291170 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5c7b25fe-f134-4fb1-a36b-91437e2b92da tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:52.291170 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5c7b25fe-f134-4fb1-a36b-91437e2b92da tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:52.418352 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-5c7b25fe-f134-4fb1-a36b-91437e2b92da tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:52.425848 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-5c7b25fe-f134-4fb1-a36b-91437e2b92da tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.148618 Aug 12 11:50:52.426413 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 86/178] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:52 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:52.733936 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-f0aaa3c5-e5d9-4b63-825d-2471565d463e tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:52.734543 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-f0aaa3c5-e5d9-4b63-825d-2471565d463e tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:52.740536 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f0aaa3c5-e5d9-4b63-825d-2471565d463e tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:52.741012 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f0aaa3c5-e5d9-4b63-825d-2471565d463e tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:52.741436 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f0aaa3c5-e5d9-4b63-825d-2471565d463e tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:52.742766 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f0aaa3c5-e5d9-4b63-825d-2471565d463e tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:52.743208 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f0aaa3c5-e5d9-4b63-825d-2471565d463e tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:52.743623 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f0aaa3c5-e5d9-4b63-825d-2471565d463e tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:52.807683 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-320ba053-83cc-48ae-883b-151087369aa7 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:52.808326 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-320ba053-83cc-48ae-883b-151087369aa7 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:52.814157 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-320ba053-83cc-48ae-883b-151087369aa7 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:52.814672 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-320ba053-83cc-48ae-883b-151087369aa7 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:52.815118 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-320ba053-83cc-48ae-883b-151087369aa7 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:52.815801 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-320ba053-83cc-48ae-883b-151087369aa7 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:52.816252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-320ba053-83cc-48ae-883b-151087369aa7 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:52.816675 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-320ba053-83cc-48ae-883b-151087369aa7 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:52.896827 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-320ba053-83cc-48ae-883b-151087369aa7 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:52.904431 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-320ba053-83cc-48ae-883b-151087369aa7 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1219 microversion: 2.1 time: 0.101492 Aug 12 11:50:52.905085 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 87/179] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:52 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:52.908332 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-f0aaa3c5-e5d9-4b63-825d-2471565d463e tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:52.916571 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-f0aaa3c5-e5d9-4b63-825d-2471565d463e tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 0.186484 Aug 12 11:50:52.917216 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 93/180] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:52 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:52.928964 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-5176ae0c-4bb5-4700-98e6-ea653e87758d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:52.930279 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-5176ae0c-4bb5-4700-98e6-ea653e87758d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:52.936977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5176ae0c-4bb5-4700-98e6-ea653e87758d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:52.937511 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5176ae0c-4bb5-4700-98e6-ea653e87758d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:52.937946 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5176ae0c-4bb5-4700-98e6-ea653e87758d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:52.938712 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5176ae0c-4bb5-4700-98e6-ea653e87758d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:52.939158 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5176ae0c-4bb5-4700-98e6-ea653e87758d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:52.939582 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5176ae0c-4bb5-4700-98e6-ea653e87758d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:53.122296 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-0471d83f-c1c3-4964-b1ba-3cb68e026ee9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:53.123018 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-0471d83f-c1c3-4964-b1ba-3cb68e026ee9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:53.128920 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0471d83f-c1c3-4964-b1ba-3cb68e026ee9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:53.129403 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0471d83f-c1c3-4964-b1ba-3cb68e026ee9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:53.129836 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0471d83f-c1c3-4964-b1ba-3cb68e026ee9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:53.130529 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0471d83f-c1c3-4964-b1ba-3cb68e026ee9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:53.131038 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0471d83f-c1c3-4964-b1ba-3cb68e026ee9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:53.131585 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0471d83f-c1c3-4964-b1ba-3cb68e026ee9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:53.187246 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-5176ae0c-4bb5-4700-98e6-ea653e87758d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:53.194728 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-5176ae0c-4bb5-4700-98e6-ea653e87758d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.269450 Aug 12 11:50:53.195751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 88/181] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:52 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:53.270872 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-0471d83f-c1c3-4964-b1ba-3cb68e026ee9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:53.279132 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-0471d83f-c1c3-4964-b1ba-3cb68e026ee9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:53.280633 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-0471d83f-c1c3-4964-b1ba-3cb68e026ee9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:53.281720 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-0471d83f-c1c3-4964-b1ba-3cb68e026ee9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.164260 Aug 12 11:50:53.282282 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 94/182] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:53 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:50:53.448007 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-49141404-1ac6-433b-9369-92e7aac2879a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:53.448520 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-49141404-1ac6-433b-9369-92e7aac2879a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:53.454302 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-49141404-1ac6-433b-9369-92e7aac2879a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:53.454847 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-49141404-1ac6-433b-9369-92e7aac2879a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:53.455281 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-49141404-1ac6-433b-9369-92e7aac2879a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:53.455962 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-49141404-1ac6-433b-9369-92e7aac2879a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:53.456412 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-49141404-1ac6-433b-9369-92e7aac2879a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:53.456859 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-49141404-1ac6-433b-9369-92e7aac2879a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:53.925538 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-7a36a7d1-41bb-4338-979f-b3a1ee2c2ba3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:53.926181 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-7a36a7d1-41bb-4338-979f-b3a1ee2c2ba3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:53.938113 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-49141404-1ac6-433b-9369-92e7aac2879a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:53.941593 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7a36a7d1-41bb-4338-979f-b3a1ee2c2ba3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:53.942086 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7a36a7d1-41bb-4338-979f-b3a1ee2c2ba3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:53.942516 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7a36a7d1-41bb-4338-979f-b3a1ee2c2ba3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:53.948004 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-49141404-1ac6-433b-9369-92e7aac2879a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.504260 Aug 12 11:50:53.948851 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7a36a7d1-41bb-4338-979f-b3a1ee2c2ba3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:53.948975 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 89/183] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:53 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:53.949595 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7a36a7d1-41bb-4338-979f-b3a1ee2c2ba3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:53.950185 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7a36a7d1-41bb-4338-979f-b3a1ee2c2ba3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:53.953781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-bab423f8-5f82-4c84-a95d-de8164a9bc3f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:53.968614 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-bab423f8-5f82-4c84-a95d-de8164a9bc3f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:53.981446 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bab423f8-5f82-4c84-a95d-de8164a9bc3f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:53.982899 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bab423f8-5f82-4c84-a95d-de8164a9bc3f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:53.988922 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bab423f8-5f82-4c84-a95d-de8164a9bc3f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:53.988922 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bab423f8-5f82-4c84-a95d-de8164a9bc3f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:53.988922 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bab423f8-5f82-4c84-a95d-de8164a9bc3f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:53.989209 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bab423f8-5f82-4c84-a95d-de8164a9bc3f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:54.045777 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-7a36a7d1-41bb-4338-979f-b3a1ee2c2ba3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:54.055273 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-7a36a7d1-41bb-4338-979f-b3a1ee2c2ba3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1267 microversion: 2.1 time: 0.132314 Aug 12 11:50:54.056122 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 95/184] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:53 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1267 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:54.111731 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-1c9914a9-9c49-4582-b737-5cd2fdb53f89 req-214f2a56-bf3d-4314-92f0-83a5ff74cb3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e56c585-652b-4059-b3f6-280d542ee20f", "name": "network-vif-plugged", "status": "completed", "tag": "22832d7b-ac7a-4e86-862c-68b38289d769"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:50:54.125020 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-1c9914a9-9c49-4582-b737-5cd2fdb53f89 req-214f2a56-bf3d-4314-92f0-83a5ff74cb3f service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:54.125600 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-1c9914a9-9c49-4582-b737-5cd2fdb53f89 req-214f2a56-bf3d-4314-92f0-83a5ff74cb3f service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:54.126148 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-1c9914a9-9c49-4582-b737-5cd2fdb53f89 req-214f2a56-bf3d-4314-92f0-83a5ff74cb3f service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:54.130428 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=100 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:54.138445 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-1c9914a9-9c49-4582-b737-5cd2fdb53f89 req-214f2a56-bf3d-4314-92f0-83a5ff74cb3f service nova] Creating event network-vif-plugged:22832d7b-ac7a-4e86-862c-68b38289d769 for instance 5e56c585-652b-4059-b3f6-280d542ee20f on hv-cinder-85282 Aug 12 11:50:54.144621 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-1c9914a9-9c49-4582-b737-5cd2fdb53f89 req-214f2a56-bf3d-4314-92f0-83a5ff74cb3f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039926 Aug 12 11:50:54.145705 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 96/185] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:50:54.190427 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-bab423f8-5f82-4c84-a95d-de8164a9bc3f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:54.199540 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-bab423f8-5f82-4c84-a95d-de8164a9bc3f tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1315 microversion: 2.1 time: 0.249420 Aug 12 11:50:54.200116 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 90/186] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:53 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:54.215712 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-06086a74-fbda-4e77-bb10-5da3f61941a7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:54.216336 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-06086a74-fbda-4e77-bb10-5da3f61941a7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:54.222676 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-06086a74-fbda-4e77-bb10-5da3f61941a7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:54.223148 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-06086a74-fbda-4e77-bb10-5da3f61941a7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:54.223571 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-06086a74-fbda-4e77-bb10-5da3f61941a7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:54.224241 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-06086a74-fbda-4e77-bb10-5da3f61941a7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:54.224686 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-06086a74-fbda-4e77-bb10-5da3f61941a7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:54.225098 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-06086a74-fbda-4e77-bb10-5da3f61941a7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:54.304964 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-af21075e-9aa6-48d8-ab87-e0f260a3345e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:54.306129 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-af21075e-9aa6-48d8-ab87-e0f260a3345e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:54.312004 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-af21075e-9aa6-48d8-ab87-e0f260a3345e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:54.312483 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-af21075e-9aa6-48d8-ab87-e0f260a3345e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:54.312913 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-af21075e-9aa6-48d8-ab87-e0f260a3345e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:54.313658 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-af21075e-9aa6-48d8-ab87-e0f260a3345e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:54.314102 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-af21075e-9aa6-48d8-ab87-e0f260a3345e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:54.314521 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-af21075e-9aa6-48d8-ab87-e0f260a3345e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:54.369734 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-06086a74-fbda-4e77-bb10-5da3f61941a7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:54.378163 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-06086a74-fbda-4e77-bb10-5da3f61941a7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.166641 Aug 12 11:50:54.379345 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 97/187] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:54 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:54.451365 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-af21075e-9aa6-48d8-ab87-e0f260a3345e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:54.459722 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-af21075e-9aa6-48d8-ab87-e0f260a3345e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:54.461819 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-af21075e-9aa6-48d8-ab87-e0f260a3345e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:54.462940 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-af21075e-9aa6-48d8-ab87-e0f260a3345e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.162463 Aug 12 11:50:54.463489 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 91/188] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:54 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:50:54.970678 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-f95c0072-a580-44e6-908b-f5c8645e9e66 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:54.971396 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-f95c0072-a580-44e6-908b-f5c8645e9e66 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:54.977382 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f95c0072-a580-44e6-908b-f5c8645e9e66 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:54.978005 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f95c0072-a580-44e6-908b-f5c8645e9e66 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:54.978506 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f95c0072-a580-44e6-908b-f5c8645e9e66 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:54.979342 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f95c0072-a580-44e6-908b-f5c8645e9e66 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:54.979879 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f95c0072-a580-44e6-908b-f5c8645e9e66 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:54.980301 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f95c0072-a580-44e6-908b-f5c8645e9e66 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:55.077265 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-8f213107-3ac6-45f9-b6c7-a01055d874bf tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:55.077942 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-8f213107-3ac6-45f9-b6c7-a01055d874bf tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:55.084496 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8f213107-3ac6-45f9-b6c7-a01055d874bf tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:55.085339 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8f213107-3ac6-45f9-b6c7-a01055d874bf tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:55.086490 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8f213107-3ac6-45f9-b6c7-a01055d874bf tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:55.087230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8f213107-3ac6-45f9-b6c7-a01055d874bf tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:55.087679 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8f213107-3ac6-45f9-b6c7-a01055d874bf tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:55.088201 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8f213107-3ac6-45f9-b6c7-a01055d874bf tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:55.115316 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-f95c0072-a580-44e6-908b-f5c8645e9e66 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:55.133903 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-f95c0072-a580-44e6-908b-f5c8645e9e66 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.166899 Aug 12 11:50:55.143238 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 98/189] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:54 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:55.168087 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-8f213107-3ac6-45f9-b6c7-a01055d874bf tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:55.176577 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-8f213107-3ac6-45f9-b6c7-a01055d874bf tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1275 microversion: 2.1 time: 0.103471 Aug 12 11:50:55.190794 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 92/190] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:55 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1275 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:55.219912 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-6a623aee-6f40-4ec9-b3d9-3b3b594da192 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:55.220515 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-6a623aee-6f40-4ec9-b3d9-3b3b594da192 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:55.230406 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6a623aee-6f40-4ec9-b3d9-3b3b594da192 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:55.231020 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6a623aee-6f40-4ec9-b3d9-3b3b594da192 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:55.231511 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6a623aee-6f40-4ec9-b3d9-3b3b594da192 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:55.232435 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6a623aee-6f40-4ec9-b3d9-3b3b594da192 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:55.232917 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6a623aee-6f40-4ec9-b3d9-3b3b594da192 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:55.233332 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6a623aee-6f40-4ec9-b3d9-3b3b594da192 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:55.395451 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-6a623aee-6f40-4ec9-b3d9-3b3b594da192 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:55.401370 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-3d6b574c-a573-45d7-80d8-96c1aa22a372 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:55.402009 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-3d6b574c-a573-45d7-80d8-96c1aa22a372 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:55.405148 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-6a623aee-6f40-4ec9-b3d9-3b3b594da192 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1503 microversion: 2.1 time: 0.188965 Aug 12 11:50:55.405759 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 99/191] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:55 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1503 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:55.408149 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3d6b574c-a573-45d7-80d8-96c1aa22a372 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:55.408630 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3d6b574c-a573-45d7-80d8-96c1aa22a372 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:55.409058 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3d6b574c-a573-45d7-80d8-96c1aa22a372 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:55.409737 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3d6b574c-a573-45d7-80d8-96c1aa22a372 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:55.410179 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3d6b574c-a573-45d7-80d8-96c1aa22a372 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:55.410595 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3d6b574c-a573-45d7-80d8-96c1aa22a372 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:55.487056 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-b9727d4b-dc02-4702-ba8b-fa8bb54111f2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:55.487660 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-b9727d4b-dc02-4702-ba8b-fa8bb54111f2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:55.495847 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b9727d4b-dc02-4702-ba8b-fa8bb54111f2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:55.496387 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b9727d4b-dc02-4702-ba8b-fa8bb54111f2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:55.500325 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b9727d4b-dc02-4702-ba8b-fa8bb54111f2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:55.503397 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b9727d4b-dc02-4702-ba8b-fa8bb54111f2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:55.503974 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b9727d4b-dc02-4702-ba8b-fa8bb54111f2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:55.504421 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b9727d4b-dc02-4702-ba8b-fa8bb54111f2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:55.609707 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-3d6b574c-a573-45d7-80d8-96c1aa22a372 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:55.619824 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-3d6b574c-a573-45d7-80d8-96c1aa22a372 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.223940 Aug 12 11:50:55.620960 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 93/192] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:55 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:55.707282 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-b9727d4b-dc02-4702-ba8b-fa8bb54111f2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:55.720093 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-b9727d4b-dc02-4702-ba8b-fa8bb54111f2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:55.721750 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-b9727d4b-dc02-4702-ba8b-fa8bb54111f2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:55.723164 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-b9727d4b-dc02-4702-ba8b-fa8bb54111f2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.240282 Aug 12 11:50:55.723824 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 100/193] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:55 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:56.156524 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-4a3eda69-a588-4cd1-a37a-2c8b1138b519 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:56.157128 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-4a3eda69-a588-4cd1-a37a-2c8b1138b519 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:56.162934 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4a3eda69-a588-4cd1-a37a-2c8b1138b519 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:56.163465 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4a3eda69-a588-4cd1-a37a-2c8b1138b519 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:56.164422 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4a3eda69-a588-4cd1-a37a-2c8b1138b519 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:56.165111 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4a3eda69-a588-4cd1-a37a-2c8b1138b519 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:56.165568 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4a3eda69-a588-4cd1-a37a-2c8b1138b519 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:56.165981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4a3eda69-a588-4cd1-a37a-2c8b1138b519 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:56.199231 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-c71bdd66-adf3-4238-bfbf-6fbf2b1fe13a tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:56.199868 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-c71bdd66-adf3-4238-bfbf-6fbf2b1fe13a tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:56.206408 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c71bdd66-adf3-4238-bfbf-6fbf2b1fe13a tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:56.207449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c71bdd66-adf3-4238-bfbf-6fbf2b1fe13a tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:56.207886 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c71bdd66-adf3-4238-bfbf-6fbf2b1fe13a tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:56.208946 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c71bdd66-adf3-4238-bfbf-6fbf2b1fe13a tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:56.209563 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c71bdd66-adf3-4238-bfbf-6fbf2b1fe13a tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:56.209987 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c71bdd66-adf3-4238-bfbf-6fbf2b1fe13a tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:56.288247 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-c71bdd66-adf3-4238-bfbf-6fbf2b1fe13a tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:56.296917 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-c71bdd66-adf3-4238-bfbf-6fbf2b1fe13a tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1285 microversion: 2.1 time: 0.103136 Aug 12 11:50:56.297701 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 101/194] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:56 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:56.375468 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-4a3eda69-a588-4cd1-a37a-2c8b1138b519 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:56.383477 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-4a3eda69-a588-4cd1-a37a-2c8b1138b519 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.230785 Aug 12 11:50:56.384080 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 94/195] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:56 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:56.640731 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-9ca16b09-7dba-40b7-b7ca-fb9a68f13686 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:56.641146 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-9ca16b09-7dba-40b7-b7ca-fb9a68f13686 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:56.647068 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9ca16b09-7dba-40b7-b7ca-fb9a68f13686 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:56.647551 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9ca16b09-7dba-40b7-b7ca-fb9a68f13686 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:56.648606 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9ca16b09-7dba-40b7-b7ca-fb9a68f13686 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:56.649359 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9ca16b09-7dba-40b7-b7ca-fb9a68f13686 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:56.649747 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9ca16b09-7dba-40b7-b7ca-fb9a68f13686 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:56.650346 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9ca16b09-7dba-40b7-b7ca-fb9a68f13686 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:56.747333 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d0c67452-3a23-4c6d-90f7-bdcee734b160 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:56.747938 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d0c67452-3a23-4c6d-90f7-bdcee734b160 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:56.753740 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d0c67452-3a23-4c6d-90f7-bdcee734b160 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:56.754224 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d0c67452-3a23-4c6d-90f7-bdcee734b160 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:56.754861 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d0c67452-3a23-4c6d-90f7-bdcee734b160 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:56.755557 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d0c67452-3a23-4c6d-90f7-bdcee734b160 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:56.756007 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d0c67452-3a23-4c6d-90f7-bdcee734b160 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:56.756589 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d0c67452-3a23-4c6d-90f7-bdcee734b160 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:56.807838 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-9ca16b09-7dba-40b7-b7ca-fb9a68f13686 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:56.815494 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-9ca16b09-7dba-40b7-b7ca-fb9a68f13686 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1363 microversion: 2.1 time: 0.178770 Aug 12 11:50:56.816051 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 102/196] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:56 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:56.892935 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-86a3ba2b-8297-49fe-9f7b-103f653f5aab tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fadaa90-e6ee-49a5-a336-27c8f8fbb1fc"}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:50:56.895651 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-86a3ba2b-8297-49fe-9f7b-103f653f5aab tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:56.902545 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86a3ba2b-8297-49fe-9f7b-103f653f5aab tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:56.903275 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86a3ba2b-8297-49fe-9f7b-103f653f5aab tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:56.903695 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86a3ba2b-8297-49fe-9f7b-103f653f5aab tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:56.904390 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86a3ba2b-8297-49fe-9f7b-103f653f5aab tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:56.904982 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86a3ba2b-8297-49fe-9f7b-103f653f5aab tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:56.905544 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86a3ba2b-8297-49fe-9f7b-103f653f5aab tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:56.910220 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d0c67452-3a23-4c6d-90f7-bdcee734b160 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:56.918881 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d0c67452-3a23-4c6d-90f7-bdcee734b160 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:56.920565 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d0c67452-3a23-4c6d-90f7-bdcee734b160 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:56.921863 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-d0c67452-3a23-4c6d-90f7-bdcee734b160 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.178388 Aug 12 11:50:56.922744 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 95/197] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:56 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:50:57.317638 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-96f3f167-042b-476e-8254-81fe4c5fedfa tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:57.318273 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-96f3f167-042b-476e-8254-81fe4c5fedfa tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:57.324222 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-96f3f167-042b-476e-8254-81fe4c5fedfa tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:57.324704 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-96f3f167-042b-476e-8254-81fe4c5fedfa tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:57.325144 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-96f3f167-042b-476e-8254-81fe4c5fedfa tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:57.325820 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-96f3f167-042b-476e-8254-81fe4c5fedfa tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:57.326303 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-96f3f167-042b-476e-8254-81fe4c5fedfa tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:57.326748 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-96f3f167-042b-476e-8254-81fe4c5fedfa tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:57.390561 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-96f3f167-042b-476e-8254-81fe4c5fedfa tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:57.393992 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=100 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:57.398870 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-96f3f167-042b-476e-8254-81fe4c5fedfa tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1273 microversion: 2.1 time: 0.084934 Aug 12 11:50:57.399431 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 96/198] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:57 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1273 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:57.403913 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-b1ce5bf6-26d2-4fcf-950c-2acb90343500 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:57.404569 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-b1ce5bf6-26d2-4fcf-950c-2acb90343500 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:57.410196 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b1ce5bf6-26d2-4fcf-950c-2acb90343500 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:57.410729 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b1ce5bf6-26d2-4fcf-950c-2acb90343500 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:57.411186 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b1ce5bf6-26d2-4fcf-950c-2acb90343500 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:57.411863 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b1ce5bf6-26d2-4fcf-950c-2acb90343500 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:57.412308 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b1ce5bf6-26d2-4fcf-950c-2acb90343500 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:57.412749 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b1ce5bf6-26d2-4fcf-950c-2acb90343500 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:57.540082 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-b1ce5bf6-26d2-4fcf-950c-2acb90343500 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:57.550777 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-b1ce5bf6-26d2-4fcf-950c-2acb90343500 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.148447 Aug 12 11:50:57.551587 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 97/199] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:57 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:57.837363 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-90741d56-4dfa-466a-9401-d41a1f9c5843 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:57.837966 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-90741d56-4dfa-466a-9401-d41a1f9c5843 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:57.843852 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-90741d56-4dfa-466a-9401-d41a1f9c5843 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:57.844325 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-90741d56-4dfa-466a-9401-d41a1f9c5843 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:57.844759 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-90741d56-4dfa-466a-9401-d41a1f9c5843 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:57.845441 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-90741d56-4dfa-466a-9401-d41a1f9c5843 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:57.845891 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-90741d56-4dfa-466a-9401-d41a1f9c5843 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:57.846312 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-90741d56-4dfa-466a-9401-d41a1f9c5843 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:57.975493 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-90741d56-4dfa-466a-9401-d41a1f9c5843 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:57.982876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-90741d56-4dfa-466a-9401-d41a1f9c5843 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1550 microversion: 2.1 time: 0.149785 Aug 12 11:50:57.983430 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 98/200] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:57 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1550 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:57.987703 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e479a35b-da88-45ec-9bf1-7b6693a808fa tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:57.988292 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-e479a35b-da88-45ec-9bf1-7b6693a808fa tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:57.993669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e479a35b-da88-45ec-9bf1-7b6693a808fa tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:57.994138 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e479a35b-da88-45ec-9bf1-7b6693a808fa tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:57.994560 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e479a35b-da88-45ec-9bf1-7b6693a808fa tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:57.995254 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e479a35b-da88-45ec-9bf1-7b6693a808fa tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:57.995700 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e479a35b-da88-45ec-9bf1-7b6693a808fa tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:57.996111 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e479a35b-da88-45ec-9bf1-7b6693a808fa tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:58.127316 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e479a35b-da88-45ec-9bf1-7b6693a808fa tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:58.135606 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e479a35b-da88-45ec-9bf1-7b6693a808fa tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:58.137091 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e479a35b-da88-45ec-9bf1-7b6693a808fa tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:58.138187 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e479a35b-da88-45ec-9bf1-7b6693a808fa tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1407 microversion: 2.20 time: 0.153861 Aug 12 11:50:58.138793 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 99/201] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:57 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:50:58.150751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-41806ff0-3ff9-44c2-b868-4c2b8fb47965 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:58.150751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-41806ff0-3ff9-44c2-b868-4c2b8fb47965 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:58.150751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-41806ff0-3ff9-44c2-b868-4c2b8fb47965 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:58.150751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-41806ff0-3ff9-44c2-b868-4c2b8fb47965 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:58.151428 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-41806ff0-3ff9-44c2-b868-4c2b8fb47965 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:58.151428 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-41806ff0-3ff9-44c2-b868-4c2b8fb47965 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:58.151738 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-41806ff0-3ff9-44c2-b868-4c2b8fb47965 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:58.152106 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-41806ff0-3ff9-44c2-b868-4c2b8fb47965 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:58.228174 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-41806ff0-3ff9-44c2-b868-4c2b8fb47965 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088289 Aug 12 11:50:58.228837 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 100/202] 10.222.0.42 () {58 vars in 1275 bytes} [Fri Aug 12 11:50:58 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:50:58.419137 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-24f23bd3-c655-43ba-a674-670212031f5b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:58.420493 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-24f23bd3-c655-43ba-a674-670212031f5b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:58.427018 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-24f23bd3-c655-43ba-a674-670212031f5b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:58.427781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-24f23bd3-c655-43ba-a674-670212031f5b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:58.428420 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-24f23bd3-c655-43ba-a674-670212031f5b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:58.429847 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-24f23bd3-c655-43ba-a674-670212031f5b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:58.430531 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-24f23bd3-c655-43ba-a674-670212031f5b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:58.431435 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-24f23bd3-c655-43ba-a674-670212031f5b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:58.574853 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-24f23bd3-c655-43ba-a674-670212031f5b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:58.583114 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-24f23bd3-c655-43ba-a674-670212031f5b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1273 microversion: 2.1 time: 0.167612 Aug 12 11:50:58.595258 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 101/203] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:58 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1273 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:50:58.603606 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e3c747f8-49df-4fdb-975c-7c76d7fe1296 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:58.604539 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-e3c747f8-49df-4fdb-975c-7c76d7fe1296 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:58.611082 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e3c747f8-49df-4fdb-975c-7c76d7fe1296 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:58.611882 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e3c747f8-49df-4fdb-975c-7c76d7fe1296 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:58.612595 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e3c747f8-49df-4fdb-975c-7c76d7fe1296 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:58.613574 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e3c747f8-49df-4fdb-975c-7c76d7fe1296 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:58.614237 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e3c747f8-49df-4fdb-975c-7c76d7fe1296 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:58.614909 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e3c747f8-49df-4fdb-975c-7c76d7fe1296 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:59.018680 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-86a3ba2b-8297-49fe-9f7b-103f653f5aab tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "POST /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.129013 Aug 12 11:50:59.020400 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 103/204] 10.222.0.42 () {60 vars in 1323 bytes} [Fri Aug 12 11:50:56 2022] POST /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c/os-volume_attachments => generated 194 bytes in 2133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:50:59.168259 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-d8b5c86a-c939-4123-9702-93f0ebd842d1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:59.169515 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-d8b5c86a-c939-4123-9702-93f0ebd842d1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:59.182130 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d8b5c86a-c939-4123-9702-93f0ebd842d1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:59.184438 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d8b5c86a-c939-4123-9702-93f0ebd842d1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:59.185178 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d8b5c86a-c939-4123-9702-93f0ebd842d1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:59.186127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d8b5c86a-c939-4123-9702-93f0ebd842d1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:59.186862 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d8b5c86a-c939-4123-9702-93f0ebd842d1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:59.187510 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d8b5c86a-c939-4123-9702-93f0ebd842d1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:59.754663 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e3c747f8-49df-4fdb-975c-7c76d7fe1296 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:59.763875 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e3c747f8-49df-4fdb-975c-7c76d7fe1296 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 1.166145 Aug 12 11:50:59.764646 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 102/205] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:58 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:50:59.779128 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-688d357a-8b53-4e80-86f5-41bd86673932 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:50:59.779863 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-688d357a-8b53-4e80-86f5-41bd86673932 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:50:59.795107 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-688d357a-8b53-4e80-86f5-41bd86673932 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:59.796796 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-688d357a-8b53-4e80-86f5-41bd86673932 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:59.801957 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-688d357a-8b53-4e80-86f5-41bd86673932 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:59.802867 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-688d357a-8b53-4e80-86f5-41bd86673932 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:50:59.803232 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-688d357a-8b53-4e80-86f5-41bd86673932 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:50:59.805023 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-688d357a-8b53-4e80-86f5-41bd86673932 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:50:59.985600 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-688d357a-8b53-4e80-86f5-41bd86673932 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:50:59.994175 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-688d357a-8b53-4e80-86f5-41bd86673932 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1273 microversion: 2.1 time: 0.227967 Aug 12 11:50:59.994812 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 103/206] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:50:59 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1273 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:00.010766 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-d8b5c86a-c939-4123-9702-93f0ebd842d1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:00.018804 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-d8b5c86a-c939-4123-9702-93f0ebd842d1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:00.021114 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-d8b5c86a-c939-4123-9702-93f0ebd842d1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:00.022762 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-d8b5c86a-c939-4123-9702-93f0ebd842d1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1599 microversion: 2.20 time: 0.864054 Aug 12 11:51:00.035594 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 104/207] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:50:59 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1599 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:51:00.051132 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-a05961c2-89de-45ed-8f9d-780eb3741161 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:00.051965 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-a05961c2-89de-45ed-8f9d-780eb3741161 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:00.059215 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a05961c2-89de-45ed-8f9d-780eb3741161 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:00.060010 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a05961c2-89de-45ed-8f9d-780eb3741161 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:00.060646 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a05961c2-89de-45ed-8f9d-780eb3741161 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:00.061687 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a05961c2-89de-45ed-8f9d-780eb3741161 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:00.062469 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a05961c2-89de-45ed-8f9d-780eb3741161 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:00.063161 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a05961c2-89de-45ed-8f9d-780eb3741161 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:00.302222 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-a05961c2-89de-45ed-8f9d-780eb3741161 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.259684 Aug 12 11:51:00.303294 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 104/208] 10.222.0.42 () {60 vars in 1316 bytes} [Fri Aug 12 11:51:00 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531/os-interface => generated 284 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 11:51:00.809734 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-3e17f434-9bec-4322-80b1-3dc61b847a31 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:00.813485 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-3e17f434-9bec-4322-80b1-3dc61b847a31 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:00.841352 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3e17f434-9bec-4322-80b1-3dc61b847a31 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:00.843181 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3e17f434-9bec-4322-80b1-3dc61b847a31 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:00.845042 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3e17f434-9bec-4322-80b1-3dc61b847a31 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:00.847557 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3e17f434-9bec-4322-80b1-3dc61b847a31 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:00.850517 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3e17f434-9bec-4322-80b1-3dc61b847a31 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:00.855387 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3e17f434-9bec-4322-80b1-3dc61b847a31 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:01.011701 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=2 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:01.013253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=8 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:01.018284 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-00b09401-d2e3-4c2d-a25b-660df76461bf tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:01.019169 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-00b09401-d2e3-4c2d-a25b-660df76461bf tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:01.039263 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-00b09401-d2e3-4c2d-a25b-660df76461bf tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:01.040045 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-00b09401-d2e3-4c2d-a25b-660df76461bf tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:01.040715 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-00b09401-d2e3-4c2d-a25b-660df76461bf tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:01.042060 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-00b09401-d2e3-4c2d-a25b-660df76461bf tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:01.042767 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-00b09401-d2e3-4c2d-a25b-660df76461bf tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:01.043407 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-00b09401-d2e3-4c2d-a25b-660df76461bf tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:01.494972 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-3e17f434-9bec-4322-80b1-3dc61b847a31 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:01.514147 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-3e17f434-9bec-4322-80b1-3dc61b847a31 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1321 microversion: 2.1 time: 0.729039 Aug 12 11:51:01.518689 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 105/209] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:00 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1321 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:01.551589 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-3f093c0b-3c69-4aa1-ab12-8e9d8dfe1858 req-a756df05-2a80-4901-ac5f-d72590bbdc87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dba7589-a4cf-4842-953b-0218eae4d3db", "tag": "e1b3cbaf-769e-41d6-b51a-8e930b076512"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:51:01.592585 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-3f093c0b-3c69-4aa1-ab12-8e9d8dfe1858 req-a756df05-2a80-4901-ac5f-d72590bbdc87 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:01.602978 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-3f093c0b-3c69-4aa1-ab12-8e9d8dfe1858 req-a756df05-2a80-4901-ac5f-d72590bbdc87 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:01.605261 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-3f093c0b-3c69-4aa1-ab12-8e9d8dfe1858 req-a756df05-2a80-4901-ac5f-d72590bbdc87 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:01.619540 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-00b09401-d2e3-4c2d-a25b-660df76461bf tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:01.635960 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-00b09401-d2e3-4c2d-a25b-660df76461bf tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1315 microversion: 2.1 time: 0.624821 Aug 12 11:51:01.637792 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 105/210] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:01 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1315 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:01.643349 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-3f093c0b-3c69-4aa1-ab12-8e9d8dfe1858 req-a756df05-2a80-4901-ac5f-d72590bbdc87 service nova] Creating event network-changed:e1b3cbaf-769e-41d6-b51a-8e930b076512 for instance 6dba7589-a4cf-4842-953b-0218eae4d3db on hv-cinder-85282 Aug 12 11:51:01.651744 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-3f093c0b-3c69-4aa1-ab12-8e9d8dfe1858 req-a756df05-2a80-4901-ac5f-d72590bbdc87 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129611 Aug 12 11:51:01.652613 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 106/211] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:51:01.838175 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-119a50d3-804f-459c-be5a-197e87f1b932 req-59fdd597-6fd4-4585-a0e9-c4f7ab6311da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "712bb3a1-789a-442f-8d59-a635f0896531", "tag": "0a1aa4d3-f810-4d8a-b28b-30a0d82ce0c9"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:51:01.847999 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-119a50d3-804f-459c-be5a-197e87f1b932 req-59fdd597-6fd4-4585-a0e9-c4f7ab6311da service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:01.848728 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-119a50d3-804f-459c-be5a-197e87f1b932 req-59fdd597-6fd4-4585-a0e9-c4f7ab6311da service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:01.853632 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-119a50d3-804f-459c-be5a-197e87f1b932 req-59fdd597-6fd4-4585-a0e9-c4f7ab6311da service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:01.866081 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-119a50d3-804f-459c-be5a-197e87f1b932 req-59fdd597-6fd4-4585-a0e9-c4f7ab6311da service nova] Creating event network-changed:0a1aa4d3-f810-4d8a-b28b-30a0d82ce0c9 for instance 712bb3a1-789a-442f-8d59-a635f0896531 on hv-cinder-85282 Aug 12 11:51:01.872612 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-119a50d3-804f-459c-be5a-197e87f1b932 req-59fdd597-6fd4-4585-a0e9-c4f7ab6311da service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038093 Aug 12 11:51:01.874003 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 106/212] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:51:02.539999 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-bcb121cc-c4ad-429a-bc05-64d5a961b66f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:02.540790 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-bcb121cc-c4ad-429a-bc05-64d5a961b66f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:02.553515 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bcb121cc-c4ad-429a-bc05-64d5a961b66f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:02.554822 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bcb121cc-c4ad-429a-bc05-64d5a961b66f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:02.556670 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bcb121cc-c4ad-429a-bc05-64d5a961b66f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:02.564977 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bcb121cc-c4ad-429a-bc05-64d5a961b66f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:02.565540 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bcb121cc-c4ad-429a-bc05-64d5a961b66f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:02.566070 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bcb121cc-c4ad-429a-bc05-64d5a961b66f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:02.659937 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-8cfb0670-31d5-485d-a8d2-c7c082ea55a5 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:02.660639 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-8cfb0670-31d5-485d-a8d2-c7c082ea55a5 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:02.669812 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8cfb0670-31d5-485d-a8d2-c7c082ea55a5 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:02.670573 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8cfb0670-31d5-485d-a8d2-c7c082ea55a5 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:02.674752 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8cfb0670-31d5-485d-a8d2-c7c082ea55a5 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:02.675496 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8cfb0670-31d5-485d-a8d2-c7c082ea55a5 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:02.675962 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8cfb0670-31d5-485d-a8d2-c7c082ea55a5 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:02.676503 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8cfb0670-31d5-485d-a8d2-c7c082ea55a5 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:03.293351 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-bcb121cc-c4ad-429a-bc05-64d5a961b66f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:03.308473 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-bcb121cc-c4ad-429a-bc05-64d5a961b66f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1515 microversion: 2.1 time: 0.769943 Aug 12 11:51:03.309324 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 107/213] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:02 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1515 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:03.335749 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e0a9c774-badb-4f5d-b455-4119177388bd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:51:03.337930 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-e0a9c774-badb-4f5d-b455-4119177388bd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:03.347501 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e0a9c774-badb-4f5d-b455-4119177388bd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:03.347979 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e0a9c774-badb-4f5d-b455-4119177388bd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:03.348411 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e0a9c774-badb-4f5d-b455-4119177388bd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:03.349123 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e0a9c774-badb-4f5d-b455-4119177388bd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:03.349573 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e0a9c774-badb-4f5d-b455-4119177388bd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:03.356445 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e0a9c774-badb-4f5d-b455-4119177388bd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:03.437754 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.objects.instance [None req-e0a9c774-badb-4f5d-b455-4119177388bd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lazy-loading 'flavor' on Instance uuid 5e56c585-652b-4059-b3f6-280d542ee20f {{(pid=132281) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:51:03.602586 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-8cfb0670-31d5-485d-a8d2-c7c082ea55a5 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:03.615873 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-8cfb0670-31d5-485d-a8d2-c7c082ea55a5 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1315 microversion: 2.1 time: 0.960103 Aug 12 11:51:03.618167 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 107/214] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:02 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1315 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:03.733443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-e0a9c774-badb-4f5d-b455-4119177388bd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "POST /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f/action" status: 200 len: 32 microversion: 2.1 time: 0.404892 Aug 12 11:51:03.739592 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 108/215] 10.222.0.42 () {60 vars in 1278 bytes} [Fri Aug 12 11:51:03 2022] POST /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f/action => generated 32 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 12 11:51:03.748349 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-fd404dda-9984-451a-8c5e-0062a2a6f1d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:03.749424 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-fd404dda-9984-451a-8c5e-0062a2a6f1d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:03.760081 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fd404dda-9984-451a-8c5e-0062a2a6f1d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:03.760690 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fd404dda-9984-451a-8c5e-0062a2a6f1d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:03.760999 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fd404dda-9984-451a-8c5e-0062a2a6f1d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:03.764926 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fd404dda-9984-451a-8c5e-0062a2a6f1d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:03.766114 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fd404dda-9984-451a-8c5e-0062a2a6f1d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:03.767566 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fd404dda-9984-451a-8c5e-0062a2a6f1d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:04.106657 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-fd404dda-9984-451a-8c5e-0062a2a6f1d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:04.127139 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-fd404dda-9984-451a-8c5e-0062a2a6f1d0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.384063 Aug 12 11:51:04.127748 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 108/216] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:03 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:51:04.365698 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-48f44d33-4bae-4d50-96a6-c2d8f812f83b req-0b780fd4-334d-4f76-b0e6-30de30d65b5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8", "tag": "81cb5cd7-9960-416c-a454-d1d1028dba1b"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:51:04.381594 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-48f44d33-4bae-4d50-96a6-c2d8f812f83b req-0b780fd4-334d-4f76-b0e6-30de30d65b5a service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:04.383065 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-48f44d33-4bae-4d50-96a6-c2d8f812f83b req-0b780fd4-334d-4f76-b0e6-30de30d65b5a service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:04.383780 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-48f44d33-4bae-4d50-96a6-c2d8f812f83b req-0b780fd4-334d-4f76-b0e6-30de30d65b5a service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:04.396915 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-48f44d33-4bae-4d50-96a6-c2d8f812f83b req-0b780fd4-334d-4f76-b0e6-30de30d65b5a service nova] Creating event network-changed:81cb5cd7-9960-416c-a454-d1d1028dba1b for instance 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 on hv-cinder-85282 Aug 12 11:51:04.408205 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-48f44d33-4bae-4d50-96a6-c2d8f812f83b req-0b780fd4-334d-4f76-b0e6-30de30d65b5a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046457 Aug 12 11:51:04.411037 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 109/217] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:51:04.637579 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-6d34bef8-db82-434b-b687-41ccba38d08b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:04.638384 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-6d34bef8-db82-434b-b687-41ccba38d08b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:04.644505 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6d34bef8-db82-434b-b687-41ccba38d08b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:04.645171 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6d34bef8-db82-434b-b687-41ccba38d08b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:04.645605 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6d34bef8-db82-434b-b687-41ccba38d08b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:04.646483 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6d34bef8-db82-434b-b687-41ccba38d08b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:04.646969 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6d34bef8-db82-434b-b687-41ccba38d08b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:04.647540 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6d34bef8-db82-434b-b687-41ccba38d08b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:04.855236 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-6d34bef8-db82-434b-b687-41ccba38d08b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:04.868906 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-6d34bef8-db82-434b-b687-41ccba38d08b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1315 microversion: 2.1 time: 0.235325 Aug 12 11:51:04.869870 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 109/218] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:04 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:05.150754 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-b30ecf04-1d42-4a82-a7ed-ac00126e406c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:05.151528 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-b30ecf04-1d42-4a82-a7ed-ac00126e406c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:05.158563 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b30ecf04-1d42-4a82-a7ed-ac00126e406c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:05.159338 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b30ecf04-1d42-4a82-a7ed-ac00126e406c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:05.160040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b30ecf04-1d42-4a82-a7ed-ac00126e406c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:05.160946 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b30ecf04-1d42-4a82-a7ed-ac00126e406c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:05.161602 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b30ecf04-1d42-4a82-a7ed-ac00126e406c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:05.162326 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b30ecf04-1d42-4a82-a7ed-ac00126e406c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:05.896228 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-b30ecf04-1d42-4a82-a7ed-ac00126e406c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:05.897953 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-40caeba5-430d-40f7-927f-cbca00c3fd4a tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:05.898565 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-40caeba5-430d-40f7-927f-cbca00c3fd4a tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:05.914327 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-40caeba5-430d-40f7-927f-cbca00c3fd4a tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:05.914862 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-40caeba5-430d-40f7-927f-cbca00c3fd4a tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:05.915294 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-40caeba5-430d-40f7-927f-cbca00c3fd4a tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:05.916189 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-40caeba5-430d-40f7-927f-cbca00c3fd4a tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:05.916789 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-40caeba5-430d-40f7-927f-cbca00c3fd4a tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:05.917356 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-40caeba5-430d-40f7-927f-cbca00c3fd4a tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:05.925409 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-b30ecf04-1d42-4a82-a7ed-ac00126e406c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.779004 Aug 12 11:51:05.926396 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 110/219] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:05 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:06.214230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-40caeba5-430d-40f7-927f-cbca00c3fd4a tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:06.227236 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-40caeba5-430d-40f7-927f-cbca00c3fd4a tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1315 microversion: 2.1 time: 0.341483 Aug 12 11:51:06.227814 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 110/220] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:05 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:06.951730 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-193993b5-98d9-4407-91c2-e6e1d79fa3e6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:06.952422 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-193993b5-98d9-4407-91c2-e6e1d79fa3e6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:06.959534 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-193993b5-98d9-4407-91c2-e6e1d79fa3e6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:06.960336 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-193993b5-98d9-4407-91c2-e6e1d79fa3e6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:06.961348 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-193993b5-98d9-4407-91c2-e6e1d79fa3e6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:06.962044 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-193993b5-98d9-4407-91c2-e6e1d79fa3e6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:06.962485 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-193993b5-98d9-4407-91c2-e6e1d79fa3e6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:06.962946 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-193993b5-98d9-4407-91c2-e6e1d79fa3e6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:06.979256 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:07.130746 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-193993b5-98d9-4407-91c2-e6e1d79fa3e6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:07.138835 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-193993b5-98d9-4407-91c2-e6e1d79fa3e6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.191023 Aug 12 11:51:07.139936 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 111/221] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:06 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:51:07.249807 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e53b8aa0-d89d-4693-a30d-e2a112ac793e tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:07.250391 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-e53b8aa0-d89d-4693-a30d-e2a112ac793e tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:07.256568 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e53b8aa0-d89d-4693-a30d-e2a112ac793e tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:07.257051 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e53b8aa0-d89d-4693-a30d-e2a112ac793e tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:07.258125 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e53b8aa0-d89d-4693-a30d-e2a112ac793e tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:07.258857 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e53b8aa0-d89d-4693-a30d-e2a112ac793e tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:07.259466 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e53b8aa0-d89d-4693-a30d-e2a112ac793e tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:07.260313 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e53b8aa0-d89d-4693-a30d-e2a112ac793e tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:07.414253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e53b8aa0-d89d-4693-a30d-e2a112ac793e tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:07.421621 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e53b8aa0-d89d-4693-a30d-e2a112ac793e tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1315 microversion: 2.1 time: 0.176905 Aug 12 11:51:07.422132 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 111/222] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:07 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:08.160702 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-20f10f4a-36d0-41cd-8da4-f910bf3c68a1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:08.161282 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-20f10f4a-36d0-41cd-8da4-f910bf3c68a1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:08.167653 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-20f10f4a-36d0-41cd-8da4-f910bf3c68a1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:08.168124 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-20f10f4a-36d0-41cd-8da4-f910bf3c68a1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:08.168576 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-20f10f4a-36d0-41cd-8da4-f910bf3c68a1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:08.169248 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-20f10f4a-36d0-41cd-8da4-f910bf3c68a1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:08.169697 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-20f10f4a-36d0-41cd-8da4-f910bf3c68a1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:08.170110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-20f10f4a-36d0-41cd-8da4-f910bf3c68a1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:08.308660 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-20f10f4a-36d0-41cd-8da4-f910bf3c68a1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:08.316584 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-20f10f4a-36d0-41cd-8da4-f910bf3c68a1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.159622 Aug 12 11:51:08.317160 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 112/223] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:08 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:08.442539 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-8ea61733-d812-4ecb-9e8b-98c4b0abd698 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:08.443461 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-8ea61733-d812-4ecb-9e8b-98c4b0abd698 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:08.454073 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8ea61733-d812-4ecb-9e8b-98c4b0abd698 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:08.454571 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8ea61733-d812-4ecb-9e8b-98c4b0abd698 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:08.455042 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8ea61733-d812-4ecb-9e8b-98c4b0abd698 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:08.455755 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8ea61733-d812-4ecb-9e8b-98c4b0abd698 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:08.456203 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8ea61733-d812-4ecb-9e8b-98c4b0abd698 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:08.456628 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8ea61733-d812-4ecb-9e8b-98c4b0abd698 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:08.595067 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-8ea61733-d812-4ecb-9e8b-98c4b0abd698 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:08.603815 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-8ea61733-d812-4ecb-9e8b-98c4b0abd698 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1315 microversion: 2.1 time: 0.164871 Aug 12 11:51:08.604087 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 112/224] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:08 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:09.337870 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-73269641-2602-4e19-8c0d-5529abd18658 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:09.338549 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-73269641-2602-4e19-8c0d-5529abd18658 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:09.345188 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-73269641-2602-4e19-8c0d-5529abd18658 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:09.345662 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-73269641-2602-4e19-8c0d-5529abd18658 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:09.346214 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-73269641-2602-4e19-8c0d-5529abd18658 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:09.346932 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-73269641-2602-4e19-8c0d-5529abd18658 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:09.347383 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-73269641-2602-4e19-8c0d-5529abd18658 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:09.347799 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-73269641-2602-4e19-8c0d-5529abd18658 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:09.543433 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-73269641-2602-4e19-8c0d-5529abd18658 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:09.550982 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-73269641-2602-4e19-8c0d-5529abd18658 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.217542 Aug 12 11:51:09.551563 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 113/225] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:09 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:09.625296 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-bcd5ee69-bea7-4f08-ade9-5ef79814f4b1 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:09.626594 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-bcd5ee69-bea7-4f08-ade9-5ef79814f4b1 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:09.628721 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:09.634488 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bcd5ee69-bea7-4f08-ade9-5ef79814f4b1 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:09.635003 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bcd5ee69-bea7-4f08-ade9-5ef79814f4b1 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:09.635443 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bcd5ee69-bea7-4f08-ade9-5ef79814f4b1 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:09.636140 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bcd5ee69-bea7-4f08-ade9-5ef79814f4b1 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:09.636592 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bcd5ee69-bea7-4f08-ade9-5ef79814f4b1 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:09.637017 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bcd5ee69-bea7-4f08-ade9-5ef79814f4b1 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:09.785044 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-bcd5ee69-bea7-4f08-ade9-5ef79814f4b1 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:09.798402 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-bcd5ee69-bea7-4f08-ade9-5ef79814f4b1 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1315 microversion: 2.1 time: 0.176625 Aug 12 11:51:09.799081 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 113/226] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:09 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:10.359417 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-58a60f90-890b-4406-8e0a-69e5dec8a2f5 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:10.359969 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-58a60f90-890b-4406-8e0a-69e5dec8a2f5 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:10.366072 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-58a60f90-890b-4406-8e0a-69e5dec8a2f5 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:10.366592 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-58a60f90-890b-4406-8e0a-69e5dec8a2f5 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:10.367047 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-58a60f90-890b-4406-8e0a-69e5dec8a2f5 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:10.367729 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-58a60f90-890b-4406-8e0a-69e5dec8a2f5 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:10.368171 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-58a60f90-890b-4406-8e0a-69e5dec8a2f5 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:10.368587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-58a60f90-890b-4406-8e0a-69e5dec8a2f5 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:10.393700 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-58a60f90-890b-4406-8e0a-69e5dec8a2f5 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Going to try to terminate instance {{(pid=132281) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 11:51:10.503144 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-58a60f90-890b-4406-8e0a-69e5dec8a2f5 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "DELETE /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 204 len: 0 microversion: 2.1 time: 0.147140 Aug 12 11:51:10.503830 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 114/227] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Aug 12 11:51:10 2022] DELETE /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 11:51:10.512126 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d5d41ffa-758a-44a6-8224-cd805ad226ee tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:10.512732 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d5d41ffa-758a-44a6-8224-cd805ad226ee tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:10.532900 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d5d41ffa-758a-44a6-8224-cd805ad226ee tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:10.533396 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d5d41ffa-758a-44a6-8224-cd805ad226ee tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:10.533832 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d5d41ffa-758a-44a6-8224-cd805ad226ee tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:10.534536 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d5d41ffa-758a-44a6-8224-cd805ad226ee tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:10.535593 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d5d41ffa-758a-44a6-8224-cd805ad226ee tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:10.536202 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d5d41ffa-758a-44a6-8224-cd805ad226ee tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:10.574497 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-20dddd27-8ff7-4778-b901-16c548135952 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:10.578337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-20dddd27-8ff7-4778-b901-16c548135952 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:10.586175 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-20dddd27-8ff7-4778-b901-16c548135952 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:10.586771 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-20dddd27-8ff7-4778-b901-16c548135952 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:10.587269 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-20dddd27-8ff7-4778-b901-16c548135952 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:10.587981 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-20dddd27-8ff7-4778-b901-16c548135952 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:10.588428 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-20dddd27-8ff7-4778-b901-16c548135952 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:10.588842 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-20dddd27-8ff7-4778-b901-16c548135952 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:10.738932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d5d41ffa-758a-44a6-8224-cd805ad226ee tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:10.743556 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=100 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:10.749847 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-d5d41ffa-758a-44a6-8224-cd805ad226ee tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1555 microversion: 2.1 time: 0.241642 Aug 12 11:51:10.750910 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 114/228] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:10 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1555 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:10.775562 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-20dddd27-8ff7-4778-b901-16c548135952 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:10.796540 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-20dddd27-8ff7-4778-b901-16c548135952 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.226832 Aug 12 11:51:10.797643 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 115/229] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:10 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:51:10.820820 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e23daf35-2c6d-46dd-a43a-044d77cd771b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:10.821431 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-e23daf35-2c6d-46dd-a43a-044d77cd771b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:10.828156 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e23daf35-2c6d-46dd-a43a-044d77cd771b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:10.828638 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e23daf35-2c6d-46dd-a43a-044d77cd771b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:10.829237 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e23daf35-2c6d-46dd-a43a-044d77cd771b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:10.830136 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e23daf35-2c6d-46dd-a43a-044d77cd771b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:10.830773 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e23daf35-2c6d-46dd-a43a-044d77cd771b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:10.833575 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e23daf35-2c6d-46dd-a43a-044d77cd771b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:10.981090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e23daf35-2c6d-46dd-a43a-044d77cd771b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:10.988807 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e23daf35-2c6d-46dd-a43a-044d77cd771b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1315 microversion: 2.1 time: 0.172304 Aug 12 11:51:10.989348 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 115/230] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:10 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:11.771342 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-01de7ffa-51a6-4244-8805-b6712e05e580 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:11.771894 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-01de7ffa-51a6-4244-8805-b6712e05e580 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:11.778821 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-01de7ffa-51a6-4244-8805-b6712e05e580 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:11.779296 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-01de7ffa-51a6-4244-8805-b6712e05e580 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:11.779722 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-01de7ffa-51a6-4244-8805-b6712e05e580 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:11.780397 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-01de7ffa-51a6-4244-8805-b6712e05e580 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:11.780843 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-01de7ffa-51a6-4244-8805-b6712e05e580 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:11.781262 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-01de7ffa-51a6-4244-8805-b6712e05e580 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:11.817709 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-efd226b4-01a6-4084-b451-56f0166c52b4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:11.818320 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-efd226b4-01a6-4084-b451-56f0166c52b4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:11.824499 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-efd226b4-01a6-4084-b451-56f0166c52b4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:11.824985 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-efd226b4-01a6-4084-b451-56f0166c52b4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:11.825430 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-efd226b4-01a6-4084-b451-56f0166c52b4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:11.826123 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-efd226b4-01a6-4084-b451-56f0166c52b4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:11.826578 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-efd226b4-01a6-4084-b451-56f0166c52b4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:11.827027 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-efd226b4-01a6-4084-b451-56f0166c52b4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:11.960966 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-01de7ffa-51a6-4244-8805-b6712e05e580 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:11.969562 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-01de7ffa-51a6-4244-8805-b6712e05e580 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1555 microversion: 2.1 time: 0.202079 Aug 12 11:51:11.970125 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 116/231] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:11 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1555 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:11.987808 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-efd226b4-01a6-4084-b451-56f0166c52b4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:11.997904 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-efd226b4-01a6-4084-b451-56f0166c52b4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.183802 Aug 12 11:51:11.998520 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 116/232] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:11 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:51:12.010709 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-cb8362a8-83b1-458f-901b-ffeda1442733 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:12.011472 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-cb8362a8-83b1-458f-901b-ffeda1442733 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:12.013512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:12.018733 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cb8362a8-83b1-458f-901b-ffeda1442733 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:12.019205 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cb8362a8-83b1-458f-901b-ffeda1442733 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:12.019634 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cb8362a8-83b1-458f-901b-ffeda1442733 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:12.020315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cb8362a8-83b1-458f-901b-ffeda1442733 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:12.020760 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cb8362a8-83b1-458f-901b-ffeda1442733 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:12.021171 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cb8362a8-83b1-458f-901b-ffeda1442733 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:12.151538 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-47608e9b-c077-41a9-a0af-a6196f2f8e36 req-a0dbadeb-6a08-45a2-b41b-5ccda2292150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8", "name": "network-vif-plugged", "status": "completed", "tag": "81cb5cd7-9960-416c-a454-d1d1028dba1b"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:51:12.163487 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-cb8362a8-83b1-458f-901b-ffeda1442733 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:12.164352 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-47608e9b-c077-41a9-a0af-a6196f2f8e36 req-a0dbadeb-6a08-45a2-b41b-5ccda2292150 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:12.165134 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-47608e9b-c077-41a9-a0af-a6196f2f8e36 req-a0dbadeb-6a08-45a2-b41b-5ccda2292150 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:12.167179 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-47608e9b-c077-41a9-a0af-a6196f2f8e36 req-a0dbadeb-6a08-45a2-b41b-5ccda2292150 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:12.173094 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-cb8362a8-83b1-458f-901b-ffeda1442733 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1315 microversion: 2.1 time: 0.166178 Aug 12 11:51:12.173689 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 117/233] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:12 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:12.179933 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-47608e9b-c077-41a9-a0af-a6196f2f8e36 req-a0dbadeb-6a08-45a2-b41b-5ccda2292150 service nova] Creating event network-vif-plugged:81cb5cd7-9960-416c-a454-d1d1028dba1b for instance 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 on hv-cinder-85282 Aug 12 11:51:12.186120 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-47608e9b-c077-41a9-a0af-a6196f2f8e36 req-a0dbadeb-6a08-45a2-b41b-5ccda2292150 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038851 Aug 12 11:51:12.186941 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 117/234] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:51:12.994380 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-89497794-f53d-4e42-baaa-f7bd84cf4439 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:12.995053 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-89497794-f53d-4e42-baaa-f7bd84cf4439 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:13.001431 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-89497794-f53d-4e42-baaa-f7bd84cf4439 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:13.001907 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-89497794-f53d-4e42-baaa-f7bd84cf4439 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:13.002336 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-89497794-f53d-4e42-baaa-f7bd84cf4439 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:13.003086 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-89497794-f53d-4e42-baaa-f7bd84cf4439 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:13.003537 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-89497794-f53d-4e42-baaa-f7bd84cf4439 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:13.003955 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-89497794-f53d-4e42-baaa-f7bd84cf4439 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:13.019819 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-6a9c0c16-85d5-4d7b-ab4c-fc4b59e499e9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:13.020434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-6a9c0c16-85d5-4d7b-ab4c-fc4b59e499e9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:13.027283 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6a9c0c16-85d5-4d7b-ab4c-fc4b59e499e9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:13.027773 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6a9c0c16-85d5-4d7b-ab4c-fc4b59e499e9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:13.028226 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6a9c0c16-85d5-4d7b-ab4c-fc4b59e499e9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:13.028920 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6a9c0c16-85d5-4d7b-ab4c-fc4b59e499e9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:13.029370 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6a9c0c16-85d5-4d7b-ab4c-fc4b59e499e9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:13.029786 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6a9c0c16-85d5-4d7b-ab4c-fc4b59e499e9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:13.221230 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-89497794-f53d-4e42-baaa-f7bd84cf4439 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:13.229675 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-89497794-f53d-4e42-baaa-f7bd84cf4439 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1555 microversion: 2.1 time: 0.242378 Aug 12 11:51:13.230341 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 118/235] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:12 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1555 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:13.234732 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-cda66b4e-29a9-46f1-84c3-01c8aee84d00 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:13.235420 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-cda66b4e-29a9-46f1-84c3-01c8aee84d00 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:13.242268 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cda66b4e-29a9-46f1-84c3-01c8aee84d00 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:13.242962 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cda66b4e-29a9-46f1-84c3-01c8aee84d00 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:13.243627 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cda66b4e-29a9-46f1-84c3-01c8aee84d00 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:13.244564 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cda66b4e-29a9-46f1-84c3-01c8aee84d00 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:13.245122 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cda66b4e-29a9-46f1-84c3-01c8aee84d00 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:13.245645 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cda66b4e-29a9-46f1-84c3-01c8aee84d00 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:13.250984 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-6a9c0c16-85d5-4d7b-ab4c-fc4b59e499e9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:13.259050 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-6a9c0c16-85d5-4d7b-ab4c-fc4b59e499e9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.243510 Aug 12 11:51:13.259600 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 118/236] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:13 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:51:13.375748 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-cda66b4e-29a9-46f1-84c3-01c8aee84d00 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:13.383791 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-cda66b4e-29a9-46f1-84c3-01c8aee84d00 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1315 microversion: 2.1 time: 0.152483 Aug 12 11:51:13.384353 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 119/237] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:13 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:14.251197 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-dc346704-beec-442b-b4eb-1b8d6fe620be tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:14.251808 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-dc346704-beec-442b-b4eb-1b8d6fe620be tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:14.258406 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-dc346704-beec-442b-b4eb-1b8d6fe620be tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:14.258922 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-dc346704-beec-442b-b4eb-1b8d6fe620be tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:14.259361 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-dc346704-beec-442b-b4eb-1b8d6fe620be tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:14.260067 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-dc346704-beec-442b-b4eb-1b8d6fe620be tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:14.260526 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-dc346704-beec-442b-b4eb-1b8d6fe620be tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:14.260949 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-dc346704-beec-442b-b4eb-1b8d6fe620be tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:14.280212 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-57f52ce2-05fe-4966-8124-e182c38e50a3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:14.280964 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-57f52ce2-05fe-4966-8124-e182c38e50a3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:14.287445 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-57f52ce2-05fe-4966-8124-e182c38e50a3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:14.287933 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-57f52ce2-05fe-4966-8124-e182c38e50a3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:14.288404 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-57f52ce2-05fe-4966-8124-e182c38e50a3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:14.290239 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-57f52ce2-05fe-4966-8124-e182c38e50a3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:14.290239 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-57f52ce2-05fe-4966-8124-e182c38e50a3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:14.290549 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-57f52ce2-05fe-4966-8124-e182c38e50a3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:14.483875 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-dc346704-beec-442b-b4eb-1b8d6fe620be tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:14.487776 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-57f52ce2-05fe-4966-8124-e182c38e50a3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:14.491792 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-dc346704-beec-442b-b4eb-1b8d6fe620be tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1555 microversion: 2.1 time: 0.244354 Aug 12 11:51:14.492357 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 119/238] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:14 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1555 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:14.495871 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-57f52ce2-05fe-4966-8124-e182c38e50a3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.219527 Aug 12 11:51:14.496500 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 120/239] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:14 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:51:14.506781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-11206d9c-76ab-4f7b-8a31-ab275481b388 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:14.506781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-11206d9c-76ab-4f7b-8a31-ab275481b388 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:14.506781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-11206d9c-76ab-4f7b-8a31-ab275481b388 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:14.506781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-11206d9c-76ab-4f7b-8a31-ab275481b388 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:14.507629 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-11206d9c-76ab-4f7b-8a31-ab275481b388 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:14.507629 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-11206d9c-76ab-4f7b-8a31-ab275481b388 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:14.507629 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-11206d9c-76ab-4f7b-8a31-ab275481b388 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:14.507629 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-11206d9c-76ab-4f7b-8a31-ab275481b388 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:14.637133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-11206d9c-76ab-4f7b-8a31-ab275481b388 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:14.644556 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-11206d9c-76ab-4f7b-8a31-ab275481b388 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1315 microversion: 2.1 time: 0.151248 Aug 12 11:51:14.645121 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 120/240] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:14 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:15.512711 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-f1e82d76-d7ab-43ec-899b-435d9713f928 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:15.513242 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-f1e82d76-d7ab-43ec-899b-435d9713f928 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:15.518288 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-fdcb69bd-ce42-4d11-a8c1-95b62de75555 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:15.518920 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-fdcb69bd-ce42-4d11-a8c1-95b62de75555 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:15.519605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f1e82d76-d7ab-43ec-899b-435d9713f928 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:15.520078 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f1e82d76-d7ab-43ec-899b-435d9713f928 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:15.520502 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f1e82d76-d7ab-43ec-899b-435d9713f928 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:15.521181 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f1e82d76-d7ab-43ec-899b-435d9713f928 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:15.521627 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f1e82d76-d7ab-43ec-899b-435d9713f928 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:15.522041 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f1e82d76-d7ab-43ec-899b-435d9713f928 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:15.525231 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fdcb69bd-ce42-4d11-a8c1-95b62de75555 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:15.525709 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fdcb69bd-ce42-4d11-a8c1-95b62de75555 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:15.526144 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fdcb69bd-ce42-4d11-a8c1-95b62de75555 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:15.526848 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fdcb69bd-ce42-4d11-a8c1-95b62de75555 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:15.527302 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fdcb69bd-ce42-4d11-a8c1-95b62de75555 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:15.527725 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fdcb69bd-ce42-4d11-a8c1-95b62de75555 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:15.723714 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-f1e82d76-d7ab-43ec-899b-435d9713f928 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:15.727509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-fdcb69bd-ce42-4d11-a8c1-95b62de75555 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:15.732229 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-f1e82d76-d7ab-43ec-899b-435d9713f928 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1555 microversion: 2.1 time: 0.223412 Aug 12 11:51:15.732932 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 121/241] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:15 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1555 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:15.735157 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-fdcb69bd-ce42-4d11-a8c1-95b62de75555 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.220565 Aug 12 11:51:15.735843 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 121/242] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:15 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:51:15.737101 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-2052b640-cfd4-4837-a19d-e101b9cc26b3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:15.737700 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-2052b640-cfd4-4837-a19d-e101b9cc26b3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:15.743293 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2052b640-cfd4-4837-a19d-e101b9cc26b3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:15.743766 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2052b640-cfd4-4837-a19d-e101b9cc26b3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:15.744191 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2052b640-cfd4-4837-a19d-e101b9cc26b3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:15.744866 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2052b640-cfd4-4837-a19d-e101b9cc26b3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:15.745312 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2052b640-cfd4-4837-a19d-e101b9cc26b3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:15.745800 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2052b640-cfd4-4837-a19d-e101b9cc26b3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:16.004107 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-2052b640-cfd4-4837-a19d-e101b9cc26b3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:16.012159 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-2052b640-cfd4-4837-a19d-e101b9cc26b3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1315 microversion: 2.1 time: 0.278415 Aug 12 11:51:16.012714 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 122/243] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:15 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:16.753033 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-745d65fb-5b6f-4a43-96ef-4d76700b0697 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:16.753638 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-745d65fb-5b6f-4a43-96ef-4d76700b0697 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:16.755534 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-98c02070-6381-4018-b5b5-f33fbd6e4cac tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:16.756144 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-98c02070-6381-4018-b5b5-f33fbd6e4cac tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:16.759582 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-745d65fb-5b6f-4a43-96ef-4d76700b0697 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:16.760133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-745d65fb-5b6f-4a43-96ef-4d76700b0697 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:16.760573 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-745d65fb-5b6f-4a43-96ef-4d76700b0697 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:16.761254 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-745d65fb-5b6f-4a43-96ef-4d76700b0697 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:16.761701 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-745d65fb-5b6f-4a43-96ef-4d76700b0697 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:16.762123 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-745d65fb-5b6f-4a43-96ef-4d76700b0697 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:16.762340 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-98c02070-6381-4018-b5b5-f33fbd6e4cac tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:16.762849 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-98c02070-6381-4018-b5b5-f33fbd6e4cac tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:16.763283 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-98c02070-6381-4018-b5b5-f33fbd6e4cac tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:16.763961 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-98c02070-6381-4018-b5b5-f33fbd6e4cac tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:16.764410 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-98c02070-6381-4018-b5b5-f33fbd6e4cac tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:16.764831 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-98c02070-6381-4018-b5b5-f33fbd6e4cac tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:16.962200 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-745d65fb-5b6f-4a43-96ef-4d76700b0697 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:16.966247 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-98c02070-6381-4018-b5b5-f33fbd6e4cac tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:16.974283 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-98c02070-6381-4018-b5b5-f33fbd6e4cac tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.222481 Aug 12 11:51:16.977775 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-745d65fb-5b6f-4a43-96ef-4d76700b0697 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1555 microversion: 2.1 time: 0.227615 Aug 12 11:51:16.978420 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 122/244] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:16 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1555 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:16.983278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 123/245] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:16 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:51:17.033934 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-85e6858a-fd23-46a1-9ac2-abf372d606b3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:17.034689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-85e6858a-fd23-46a1-9ac2-abf372d606b3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:17.041461 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-85e6858a-fd23-46a1-9ac2-abf372d606b3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:17.041928 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-85e6858a-fd23-46a1-9ac2-abf372d606b3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:17.042356 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-85e6858a-fd23-46a1-9ac2-abf372d606b3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:17.043082 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-85e6858a-fd23-46a1-9ac2-abf372d606b3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:17.043554 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-85e6858a-fd23-46a1-9ac2-abf372d606b3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:17.043971 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-85e6858a-fd23-46a1-9ac2-abf372d606b3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:17.173215 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-b6c43a50-ff4d-4f97-b931-47ee6abba3f7 req-800aa5f4-2fbe-4458-8c3e-7061bcfa78f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17168892-79e0-4148-94f8-9034d13d060c", "name": "network-vif-unplugged", "status": "completed", "tag": "d7d8ffb8-c0a5-4afc-b4c5-f929667db09c"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:51:17.183901 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-b6c43a50-ff4d-4f97-b931-47ee6abba3f7 req-800aa5f4-2fbe-4458-8c3e-7061bcfa78f9 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:17.184370 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-b6c43a50-ff4d-4f97-b931-47ee6abba3f7 req-800aa5f4-2fbe-4458-8c3e-7061bcfa78f9 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:17.184949 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-b6c43a50-ff4d-4f97-b931-47ee6abba3f7 req-800aa5f4-2fbe-4458-8c3e-7061bcfa78f9 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:17.196798 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-85e6858a-fd23-46a1-9ac2-abf372d606b3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:17.197839 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-b6c43a50-ff4d-4f97-b931-47ee6abba3f7 req-800aa5f4-2fbe-4458-8c3e-7061bcfa78f9 service nova] Creating event network-vif-unplugged:d7d8ffb8-c0a5-4afc-b4c5-f929667db09c for instance 17168892-79e0-4148-94f8-9034d13d060c on hv-cinder-85282 Aug 12 11:51:17.203108 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-b6c43a50-ff4d-4f97-b931-47ee6abba3f7 req-800aa5f4-2fbe-4458-8c3e-7061bcfa78f9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033698 Aug 12 11:51:17.204336 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 124/246] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:51:17.208078 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-85e6858a-fd23-46a1-9ac2-abf372d606b3 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1315 microversion: 2.1 time: 0.178349 Aug 12 11:51:17.220005 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 123/247] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:17 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:17.996713 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-073154e1-e101-433c-924a-161dfcaeea75 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:17.997422 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-073154e1-e101-433c-924a-161dfcaeea75 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:17.999960 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-76c7b55c-3d5a-451b-8441-ed1d4990a847 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:18.000569 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-76c7b55c-3d5a-451b-8441-ed1d4990a847 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:18.003744 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-073154e1-e101-433c-924a-161dfcaeea75 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:18.004215 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-073154e1-e101-433c-924a-161dfcaeea75 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:18.004644 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-073154e1-e101-433c-924a-161dfcaeea75 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:18.005329 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-073154e1-e101-433c-924a-161dfcaeea75 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:18.005774 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-073154e1-e101-433c-924a-161dfcaeea75 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:18.006185 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-073154e1-e101-433c-924a-161dfcaeea75 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:18.006364 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-76c7b55c-3d5a-451b-8441-ed1d4990a847 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:18.006885 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-76c7b55c-3d5a-451b-8441-ed1d4990a847 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:18.007320 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-76c7b55c-3d5a-451b-8441-ed1d4990a847 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:18.008661 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-76c7b55c-3d5a-451b-8441-ed1d4990a847 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:18.009026 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-76c7b55c-3d5a-451b-8441-ed1d4990a847 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:18.009450 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-76c7b55c-3d5a-451b-8441-ed1d4990a847 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:18.210193 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-073154e1-e101-433c-924a-161dfcaeea75 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:18.217673 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-76c7b55c-3d5a-451b-8441-ed1d4990a847 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:18.218028 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-073154e1-e101-433c-924a-161dfcaeea75 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.226312 Aug 12 11:51:18.218698 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 125/248] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:17 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:18.225512 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-76c7b55c-3d5a-451b-8441-ed1d4990a847 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1555 microversion: 2.1 time: 0.229905 Aug 12 11:51:18.226213 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 124/249] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:17 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1555 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:51:18.228236 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-1ac2cb5d-9d7c-432e-a5fd-9a8e8b1b13ad tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:18.228944 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-1ac2cb5d-9d7c-432e-a5fd-9a8e8b1b13ad tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:18.234965 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1ac2cb5d-9d7c-432e-a5fd-9a8e8b1b13ad tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:18.235536 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1ac2cb5d-9d7c-432e-a5fd-9a8e8b1b13ad tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:18.236041 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1ac2cb5d-9d7c-432e-a5fd-9a8e8b1b13ad tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:18.236791 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1ac2cb5d-9d7c-432e-a5fd-9a8e8b1b13ad tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:18.237318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1ac2cb5d-9d7c-432e-a5fd-9a8e8b1b13ad tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:18.237808 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1ac2cb5d-9d7c-432e-a5fd-9a8e8b1b13ad tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:18.370493 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-1ac2cb5d-9d7c-432e-a5fd-9a8e8b1b13ad tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:18.377855 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-1ac2cb5d-9d7c-432e-a5fd-9a8e8b1b13ad tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1315 microversion: 2.1 time: 0.153896 Aug 12 11:51:18.378408 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 126/250] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:18 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:19.240722 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-7a31bbab-2ea9-4831-87c0-5211233934fd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:19.240722 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-7a31bbab-2ea9-4831-87c0-5211233934fd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:19.246330 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7a31bbab-2ea9-4831-87c0-5211233934fd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:19.246852 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7a31bbab-2ea9-4831-87c0-5211233934fd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:19.247280 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7a31bbab-2ea9-4831-87c0-5211233934fd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:19.247527 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-4406e916-dff7-4e1e-8f2d-c68de2bfe5cf tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:19.248006 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7a31bbab-2ea9-4831-87c0-5211233934fd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:19.248170 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-4406e916-dff7-4e1e-8f2d-c68de2bfe5cf tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:19.248413 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7a31bbab-2ea9-4831-87c0-5211233934fd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:19.248837 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7a31bbab-2ea9-4831-87c0-5211233934fd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:19.256657 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4406e916-dff7-4e1e-8f2d-c68de2bfe5cf tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:19.257128 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4406e916-dff7-4e1e-8f2d-c68de2bfe5cf tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:19.257558 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4406e916-dff7-4e1e-8f2d-c68de2bfe5cf tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:19.258257 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4406e916-dff7-4e1e-8f2d-c68de2bfe5cf tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:19.259427 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4406e916-dff7-4e1e-8f2d-c68de2bfe5cf tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:19.259837 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4406e916-dff7-4e1e-8f2d-c68de2bfe5cf tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:19.262627 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:19.448922 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-7a31bbab-2ea9-4831-87c0-5211233934fd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:19.455456 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-4406e916-dff7-4e1e-8f2d-c68de2bfe5cf tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:19.456519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-7a31bbab-2ea9-4831-87c0-5211233934fd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.220898 Aug 12 11:51:19.457295 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 125/251] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:19 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:19.461598 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-4c682cc4-7581-40cd-85df-269d28341009 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:19.462200 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-4c682cc4-7581-40cd-85df-269d28341009 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:19.463325 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-4406e916-dff7-4e1e-8f2d-c68de2bfe5cf tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1555 microversion: 2.1 time: 0.220780 Aug 12 11:51:19.464117 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 127/252] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:19 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1555 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:51:19.468458 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4c682cc4-7581-40cd-85df-269d28341009 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:19.469030 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4c682cc4-7581-40cd-85df-269d28341009 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:19.469533 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4c682cc4-7581-40cd-85df-269d28341009 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:19.470286 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4c682cc4-7581-40cd-85df-269d28341009 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:19.470920 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4c682cc4-7581-40cd-85df-269d28341009 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:19.471406 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4c682cc4-7581-40cd-85df-269d28341009 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:19.600182 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-4c682cc4-7581-40cd-85df-269d28341009 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:19.608056 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-4c682cc4-7581-40cd-85df-269d28341009 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1315 microversion: 2.1 time: 0.149933 Aug 12 11:51:19.608611 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 126/253] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:19 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:20.477714 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-d2d1b25f-813d-4be8-ba03-c54eed7dbd45 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:20.478408 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-d2d1b25f-813d-4be8-ba03-c54eed7dbd45 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:20.484292 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-54fd203d-5b50-47ec-b4f0-62b25957500a tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:20.484828 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-54fd203d-5b50-47ec-b4f0-62b25957500a tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:20.484937 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d2d1b25f-813d-4be8-ba03-c54eed7dbd45 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:20.485314 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d2d1b25f-813d-4be8-ba03-c54eed7dbd45 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:20.485743 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d2d1b25f-813d-4be8-ba03-c54eed7dbd45 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:20.486422 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d2d1b25f-813d-4be8-ba03-c54eed7dbd45 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:20.486895 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d2d1b25f-813d-4be8-ba03-c54eed7dbd45 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:20.487310 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d2d1b25f-813d-4be8-ba03-c54eed7dbd45 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:20.490756 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-54fd203d-5b50-47ec-b4f0-62b25957500a tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:20.491231 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-54fd203d-5b50-47ec-b4f0-62b25957500a tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:20.491656 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-54fd203d-5b50-47ec-b4f0-62b25957500a tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:20.492330 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-54fd203d-5b50-47ec-b4f0-62b25957500a tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:20.492773 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-54fd203d-5b50-47ec-b4f0-62b25957500a tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:20.493187 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-54fd203d-5b50-47ec-b4f0-62b25957500a tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:20.680325 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-d2d1b25f-813d-4be8-ba03-c54eed7dbd45 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:20.684991 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-54fd203d-5b50-47ec-b4f0-62b25957500a tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:20.688743 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-d2d1b25f-813d-4be8-ba03-c54eed7dbd45 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.215395 Aug 12 11:51:20.689320 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 128/254] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:20 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:20.692916 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-54fd203d-5b50-47ec-b4f0-62b25957500a tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1555 microversion: 2.1 time: 0.212495 Aug 12 11:51:20.693455 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 127/255] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:20 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1555 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:51:20.697471 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-5bd02d77-0466-4d6c-b285-d94c26c6e3c1 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:20.698581 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-5bd02d77-0466-4d6c-b285-d94c26c6e3c1 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:20.704577 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5bd02d77-0466-4d6c-b285-d94c26c6e3c1 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:20.705162 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5bd02d77-0466-4d6c-b285-d94c26c6e3c1 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:20.705593 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5bd02d77-0466-4d6c-b285-d94c26c6e3c1 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:20.706302 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5bd02d77-0466-4d6c-b285-d94c26c6e3c1 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:20.706781 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5bd02d77-0466-4d6c-b285-d94c26c6e3c1 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:20.707200 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5bd02d77-0466-4d6c-b285-d94c26c6e3c1 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:20.872597 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-5bd02d77-0466-4d6c-b285-d94c26c6e3c1 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:20.879995 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-5bd02d77-0466-4d6c-b285-d94c26c6e3c1 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1315 microversion: 2.1 time: 0.189743 Aug 12 11:51:20.880585 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 129/256] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:20 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:21.710308 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-8ae3c516-5030-4d2a-b1a4-05f0d43414f4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:21.710886 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-8ae3c516-5030-4d2a-b1a4-05f0d43414f4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:21.714261 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-2e33ea21-6d77-496e-927b-54c9e85d4761 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:21.714885 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-2e33ea21-6d77-496e-927b-54c9e85d4761 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:21.717167 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8ae3c516-5030-4d2a-b1a4-05f0d43414f4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:21.717641 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8ae3c516-5030-4d2a-b1a4-05f0d43414f4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:21.718066 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8ae3c516-5030-4d2a-b1a4-05f0d43414f4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:21.718776 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8ae3c516-5030-4d2a-b1a4-05f0d43414f4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:21.719220 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8ae3c516-5030-4d2a-b1a4-05f0d43414f4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:21.719632 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8ae3c516-5030-4d2a-b1a4-05f0d43414f4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:21.721130 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2e33ea21-6d77-496e-927b-54c9e85d4761 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:21.721606 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2e33ea21-6d77-496e-927b-54c9e85d4761 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:21.722057 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2e33ea21-6d77-496e-927b-54c9e85d4761 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:21.722769 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2e33ea21-6d77-496e-927b-54c9e85d4761 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:21.723222 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2e33ea21-6d77-496e-927b-54c9e85d4761 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:21.723648 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2e33ea21-6d77-496e-927b-54c9e85d4761 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:22.002307 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-8ae3c516-5030-4d2a-b1a4-05f0d43414f4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:22.010789 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-8ae3c516-5030-4d2a-b1a4-05f0d43414f4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.304110 Aug 12 11:51:22.011363 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 128/257] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:21 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:22.015942 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-8f1a822d-88b0-4cd9-b549-0f514ab6da3b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:22.016548 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-8f1a822d-88b0-4cd9-b549-0f514ab6da3b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:22.022638 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8f1a822d-88b0-4cd9-b549-0f514ab6da3b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:22.023201 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8f1a822d-88b0-4cd9-b549-0f514ab6da3b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:22.023627 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8f1a822d-88b0-4cd9-b549-0f514ab6da3b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:22.024311 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8f1a822d-88b0-4cd9-b549-0f514ab6da3b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:22.024758 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8f1a822d-88b0-4cd9-b549-0f514ab6da3b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:22.025209 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8f1a822d-88b0-4cd9-b549-0f514ab6da3b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:22.033224 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-2e33ea21-6d77-496e-927b-54c9e85d4761 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:22.042133 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-2e33ea21-6d77-496e-927b-54c9e85d4761 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1555 microversion: 2.1 time: 0.332023 Aug 12 11:51:22.042920 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 130/258] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:21 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1555 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:51:22.227990 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-8f1a822d-88b0-4cd9-b549-0f514ab6da3b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:22.235257 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-8f1a822d-88b0-4cd9-b549-0f514ab6da3b tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1465 microversion: 2.1 time: 0.222882 Aug 12 11:51:22.235818 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 129/259] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:22 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1465 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:22.280775 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-f97d27de-cfcc-411a-876a-acd869e8b875 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:22.281314 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-f97d27de-cfcc-411a-876a-acd869e8b875 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:22.287313 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f97d27de-cfcc-411a-876a-acd869e8b875 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:22.287867 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f97d27de-cfcc-411a-876a-acd869e8b875 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:22.288301 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f97d27de-cfcc-411a-876a-acd869e8b875 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:22.288978 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f97d27de-cfcc-411a-876a-acd869e8b875 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:22.289426 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f97d27de-cfcc-411a-876a-acd869e8b875 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:22.289841 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f97d27de-cfcc-411a-876a-acd869e8b875 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:22.314770 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-f97d27de-cfcc-411a-876a-acd869e8b875 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Going to try to terminate instance {{(pid=132281) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 11:51:22.390369 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-f97d27de-cfcc-411a-876a-acd869e8b875 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "DELETE /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 204 len: 0 microversion: 2.1 time: 0.113184 Aug 12 11:51:22.390997 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 131/260] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Aug 12 11:51:22 2022] DELETE /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 11:51:22.399007 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-0cb8aa42-783b-4948-bcc0-a6d39cddc546 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:22.399628 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-0cb8aa42-783b-4948-bcc0-a6d39cddc546 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:22.405539 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0cb8aa42-783b-4948-bcc0-a6d39cddc546 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:22.406064 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0cb8aa42-783b-4948-bcc0-a6d39cddc546 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:22.406446 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0cb8aa42-783b-4948-bcc0-a6d39cddc546 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:22.407165 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0cb8aa42-783b-4948-bcc0-a6d39cddc546 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:22.407615 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0cb8aa42-783b-4948-bcc0-a6d39cddc546 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:22.408040 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0cb8aa42-783b-4948-bcc0-a6d39cddc546 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:22.520133 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-8025b314-a8c7-4d6a-8779-99e4d0a1deb5 req-d7dfaac2-8c84-4feb-ba4e-941646fd1e5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17168892-79e0-4148-94f8-9034d13d060c", "name": "network-vif-deleted", "tag": "d7d8ffb8-c0a5-4afc-b4c5-f929667db09c"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:51:22.529645 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-8025b314-a8c7-4d6a-8779-99e4d0a1deb5 req-d7dfaac2-8c84-4feb-ba4e-941646fd1e5b service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:22.530114 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-8025b314-a8c7-4d6a-8779-99e4d0a1deb5 req-d7dfaac2-8c84-4feb-ba4e-941646fd1e5b service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:22.530534 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-8025b314-a8c7-4d6a-8779-99e4d0a1deb5 req-d7dfaac2-8c84-4feb-ba4e-941646fd1e5b service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:22.543370 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-8025b314-a8c7-4d6a-8779-99e4d0a1deb5 req-d7dfaac2-8c84-4feb-ba4e-941646fd1e5b service nova] Creating event network-vif-deleted:d7d8ffb8-c0a5-4afc-b4c5-f929667db09c for instance 17168892-79e0-4148-94f8-9034d13d060c on hv-cinder-85282 Aug 12 11:51:22.548773 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-8025b314-a8c7-4d6a-8779-99e4d0a1deb5 req-d7dfaac2-8c84-4feb-ba4e-941646fd1e5b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032523 Aug 12 11:51:22.549531 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 132/261] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:51:22.588290 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-0cb8aa42-783b-4948-bcc0-a6d39cddc546 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:22.595874 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-0cb8aa42-783b-4948-bcc0-a6d39cddc546 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1471 microversion: 2.1 time: 0.200672 Aug 12 11:51:22.596445 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 130/262] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:22 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1471 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:23.037304 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-ac15090c-cd2a-4baa-a5ef-2ae428b81360 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:23.038275 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-ac15090c-cd2a-4baa-a5ef-2ae428b81360 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:23.045673 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ac15090c-cd2a-4baa-a5ef-2ae428b81360 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:23.046162 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ac15090c-cd2a-4baa-a5ef-2ae428b81360 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:23.046599 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ac15090c-cd2a-4baa-a5ef-2ae428b81360 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:23.047310 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ac15090c-cd2a-4baa-a5ef-2ae428b81360 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:23.047762 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ac15090c-cd2a-4baa-a5ef-2ae428b81360 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:23.048274 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ac15090c-cd2a-4baa-a5ef-2ae428b81360 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:23.062872 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-1c747281-1c21-4433-9991-9488be3233b0 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:23.063476 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-1c747281-1c21-4433-9991-9488be3233b0 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:23.069146 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1c747281-1c21-4433-9991-9488be3233b0 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:23.069801 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1c747281-1c21-4433-9991-9488be3233b0 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:23.070235 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1c747281-1c21-4433-9991-9488be3233b0 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:23.071034 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1c747281-1c21-4433-9991-9488be3233b0 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:23.072598 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1c747281-1c21-4433-9991-9488be3233b0 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:23.072598 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1c747281-1c21-4433-9991-9488be3233b0 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:23.142930 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-1c747281-1c21-4433-9991-9488be3233b0 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:23.151279 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-1c747281-1c21-4433-9991-9488be3233b0 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1513 microversion: 2.1 time: 0.091698 Aug 12 11:51:23.151844 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 131/263] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:23 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1513 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:51:23.201072 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-ac15090c-cd2a-4baa-a5ef-2ae428b81360 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:23.208669 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-ac15090c-cd2a-4baa-a5ef-2ae428b81360 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.176762 Aug 12 11:51:23.209245 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 133/264] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:23 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:23.619190 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-6ada89cd-6957-46d2-8dcc-b639104a6262 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:23.619926 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-6ada89cd-6957-46d2-8dcc-b639104a6262 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:23.626197 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6ada89cd-6957-46d2-8dcc-b639104a6262 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:23.626713 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6ada89cd-6957-46d2-8dcc-b639104a6262 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:23.627150 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6ada89cd-6957-46d2-8dcc-b639104a6262 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:23.627849 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6ada89cd-6957-46d2-8dcc-b639104a6262 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:23.628297 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6ada89cd-6957-46d2-8dcc-b639104a6262 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:23.628721 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6ada89cd-6957-46d2-8dcc-b639104a6262 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:23.633403 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=100 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:23.767009 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-6ada89cd-6957-46d2-8dcc-b639104a6262 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:23.774458 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-6ada89cd-6957-46d2-8dcc-b639104a6262 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1471 microversion: 2.1 time: 0.159153 Aug 12 11:51:23.775277 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 132/265] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:23 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:24.172583 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-4d6e32ed-1730-4c7c-829c-191098320859 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:24.173202 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-4d6e32ed-1730-4c7c-829c-191098320859 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:24.179519 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4d6e32ed-1730-4c7c-829c-191098320859 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:24.180000 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4d6e32ed-1730-4c7c-829c-191098320859 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:24.180428 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4d6e32ed-1730-4c7c-829c-191098320859 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:24.181350 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4d6e32ed-1730-4c7c-829c-191098320859 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:24.182945 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4d6e32ed-1730-4c7c-829c-191098320859 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:24.183442 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4d6e32ed-1730-4c7c-829c-191098320859 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:24.229941 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-f34cfea8-65b7-4dfd-afe6-3701c30df499 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:24.230550 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-f34cfea8-65b7-4dfd-afe6-3701c30df499 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:24.246000 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f34cfea8-65b7-4dfd-afe6-3701c30df499 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:24.246500 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f34cfea8-65b7-4dfd-afe6-3701c30df499 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:24.246962 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f34cfea8-65b7-4dfd-afe6-3701c30df499 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:24.247663 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f34cfea8-65b7-4dfd-afe6-3701c30df499 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:24.248118 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f34cfea8-65b7-4dfd-afe6-3701c30df499 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:24.248542 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f34cfea8-65b7-4dfd-afe6-3701c30df499 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:24.264649 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-4d6e32ed-1730-4c7c-829c-191098320859 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:24.273664 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-4d6e32ed-1730-4c7c-829c-191098320859 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1513 microversion: 2.1 time: 0.104964 Aug 12 11:51:24.274232 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 134/266] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:24 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1513 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:24.377182 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-f34cfea8-65b7-4dfd-afe6-3701c30df499 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:24.384556 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-f34cfea8-65b7-4dfd-afe6-3701c30df499 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.158960 Aug 12 11:51:24.385114 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 133/267] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:24 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:24.795431 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-305b4550-a192-4467-b2ba-c70858b989f2 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:24.795955 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-305b4550-a192-4467-b2ba-c70858b989f2 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:24.801735 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-305b4550-a192-4467-b2ba-c70858b989f2 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:24.802203 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-305b4550-a192-4467-b2ba-c70858b989f2 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:24.802648 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-305b4550-a192-4467-b2ba-c70858b989f2 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:24.803330 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-305b4550-a192-4467-b2ba-c70858b989f2 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:24.803773 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-305b4550-a192-4467-b2ba-c70858b989f2 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:24.804185 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-305b4550-a192-4467-b2ba-c70858b989f2 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:25.260788 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-305b4550-a192-4467-b2ba-c70858b989f2 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:25.269378 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-305b4550-a192-4467-b2ba-c70858b989f2 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1471 microversion: 2.1 time: 0.477728 Aug 12 11:51:25.278857 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 135/268] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:24 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1471 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:25.295598 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-440f1239-01d3-47ca-9965-4f7aa103edf5 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:25.296751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-440f1239-01d3-47ca-9965-4f7aa103edf5 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:25.303395 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-440f1239-01d3-47ca-9965-4f7aa103edf5 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:25.303878 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-440f1239-01d3-47ca-9965-4f7aa103edf5 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:25.304311 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-440f1239-01d3-47ca-9965-4f7aa103edf5 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:25.305003 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-440f1239-01d3-47ca-9965-4f7aa103edf5 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:25.305453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-440f1239-01d3-47ca-9965-4f7aa103edf5 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:25.305875 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-440f1239-01d3-47ca-9965-4f7aa103edf5 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:25.337748 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-440f1239-01d3-47ca-9965-4f7aa103edf5 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:25.338360 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-440f1239-01d3-47ca-9965-4f7aa103edf5 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:25.338831 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-440f1239-01d3-47ca-9965-4f7aa103edf5 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:25.339292 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.objects.instance [None req-440f1239-01d3-47ca-9965-4f7aa103edf5 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lazy-loading 'fault' on Instance uuid 17168892-79e0-4148-94f8-9034d13d060c {{(pid=132282) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:51:25.405652 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-fe478e59-5493-4361-af49-dfd6df674fb3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:25.406267 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-fe478e59-5493-4361-af49-dfd6df674fb3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:25.406504 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-440f1239-01d3-47ca-9965-4f7aa103edf5 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134faab760d04e3ba537619281c316c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06451ebec8a947829019e1fea6636bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:25.412583 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fe478e59-5493-4361-af49-dfd6df674fb3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:25.413280 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fe478e59-5493-4361-af49-dfd6df674fb3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:25.413958 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fe478e59-5493-4361-af49-dfd6df674fb3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:25.414555 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-440f1239-01d3-47ca-9965-4f7aa103edf5 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 200 len: 1351 microversion: 2.1 time: 0.123726 Aug 12 11:51:25.414831 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fe478e59-5493-4361-af49-dfd6df674fb3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:25.415158 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 134/269] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:25 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 1351 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:51:25.415604 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fe478e59-5493-4361-af49-dfd6df674fb3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:25.416032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fe478e59-5493-4361-af49-dfd6df674fb3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:25.563719 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-d4751a1c-bb47-4dde-add5-b7bfb8b991a3 req-e25b13dc-4ba4-4a5e-8e92-c6c909e17753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8", "name": "network-vif-deleted", "tag": "81cb5cd7-9960-416c-a454-d1d1028dba1b"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:51:25.574455 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-d4751a1c-bb47-4dde-add5-b7bfb8b991a3 req-e25b13dc-4ba4-4a5e-8e92-c6c909e17753 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:25.574961 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-d4751a1c-bb47-4dde-add5-b7bfb8b991a3 req-e25b13dc-4ba4-4a5e-8e92-c6c909e17753 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:25.575433 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-d4751a1c-bb47-4dde-add5-b7bfb8b991a3 req-e25b13dc-4ba4-4a5e-8e92-c6c909e17753 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:25.595669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-d4751a1c-bb47-4dde-add5-b7bfb8b991a3 req-e25b13dc-4ba4-4a5e-8e92-c6c909e17753 service nova] Creating event network-vif-deleted:81cb5cd7-9960-416c-a454-d1d1028dba1b for instance 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 on hv-cinder-85282 Aug 12 11:51:25.606108 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-d4751a1c-bb47-4dde-add5-b7bfb8b991a3 req-e25b13dc-4ba4-4a5e-8e92-c6c909e17753 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045836 Aug 12 11:51:25.611028 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 135/270] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:51:25.646631 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-fe478e59-5493-4361-af49-dfd6df674fb3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:25.654489 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-fe478e59-5493-4361-af49-dfd6df674fb3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.252747 Aug 12 11:51:25.655153 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 136/271] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:25 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:51:26.291319 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-a28853b6-2b8d-4cb4-bc2f-57d241c243d6 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:26.292002 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-a28853b6-2b8d-4cb4-bc2f-57d241c243d6 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:26.297931 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a28853b6-2b8d-4cb4-bc2f-57d241c243d6 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:26.298473 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a28853b6-2b8d-4cb4-bc2f-57d241c243d6 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:26.298858 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a28853b6-2b8d-4cb4-bc2f-57d241c243d6 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:26.299525 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a28853b6-2b8d-4cb4-bc2f-57d241c243d6 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:26.299968 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a28853b6-2b8d-4cb4-bc2f-57d241c243d6 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:26.300382 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a28853b6-2b8d-4cb4-bc2f-57d241c243d6 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:26.364632 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-a28853b6-2b8d-4cb4-bc2f-57d241c243d6 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:26.372002 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-a28853b6-2b8d-4cb4-bc2f-57d241c243d6 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1300 microversion: 2.1 time: 0.084767 Aug 12 11:51:26.372551 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 136/272] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:26 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1300 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:26.436258 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-bee2042f-5145-431d-9fd0-b52e905a8e00 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:26.436887 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-bee2042f-5145-431d-9fd0-b52e905a8e00 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:26.443211 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bee2042f-5145-431d-9fd0-b52e905a8e00 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:26.443688 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bee2042f-5145-431d-9fd0-b52e905a8e00 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:26.444116 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bee2042f-5145-431d-9fd0-b52e905a8e00 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:26.444803 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bee2042f-5145-431d-9fd0-b52e905a8e00 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:26.445252 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bee2042f-5145-431d-9fd0-b52e905a8e00 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:26.445670 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bee2042f-5145-431d-9fd0-b52e905a8e00 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:26.459371 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.wsgi [None req-bee2042f-5145-431d-9fd0-b52e905a8e00 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] HTTP exception thrown: Instance 17168892-79e0-4148-94f8-9034d13d060c could not be found. Aug 12 11:51:26.464414 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-bee2042f-5145-431d-9fd0-b52e905a8e00 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Request method failure captured: Aug 12 11:51:26.464414 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c HTTP/1.1 Aug 12 11:51:26.464414 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 11:51:26.464414 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 11:51:26.464414 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 11:51:26.464414 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 0 Aug 12 11:51:26.464414 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 11:51:26.464414 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 11:51:26.464414 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 11:51:26.464414 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 11:51:26.464414 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9j5libPhc7ZYZoha4BsbMnnXGyUIa1LdFBpNhEqtQ1zdnMcNrakomJrpRGowRLWcGu9T3_1wC5XiU-Br_-_sNG6ntVTf-hYWHL1lUDk18FEY6-uaCY4pn0E6k-kKKjtemGhz7AnuwW8jDIrFbLmPZJV5Xioo-P-0OKIEPfZmUpA4odA Aug 12 11:51:26.464414 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 11:51:26.464414 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 11:51:26.464414 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 11:51:26.464414 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 11:51:26.464414 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 11:51:26.464414 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 11:51:26.464414 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: 06451ebec8a947829019e1fea6636bc6 Aug 12 11:51:26.464414 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-DeleteServersTestJSON-792612196 Aug 12 11:51:26.464414 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 11:51:26.464414 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 11:51:26.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_06451ebec8a947829019e1fea6636bc6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/06451ebec8a947829019e1fea6636bc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/06451ebec8a947829019e1fea6636bc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/06451ebec8a947829019e1fea6636bc6"}]}] Aug 12 11:51:26.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-DeleteServersTestJSON-792612196 Aug 12 11:51:26.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: 06451ebec8a947829019e1fea6636bc6 Aug 12 11:51:26.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-DeleteServersTestJSON-792612196 Aug 12 11:51:26.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-DeleteServersTestJSON-792612196-project Aug 12 11:51:26.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 11:51:26.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 11:51:26.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: 134faab760d04e3ba537619281c316c9 Aug 12 11:51:26.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-DeleteServersTestJSON-792612196-project Aug 12 11:51:26.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: > Aug 12 11:51:26.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Instance 17168892-79e0-4148-94f8-9034d13d060c could not be found. Aug 12 11:51:26.465854 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'id': '17168892-79e0-4148-94f8-9034d13d060c'} Aug 12 11:51:26.466777 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:51:26.466777 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:26.466777 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:51:26.466777 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:51:26.466777 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:51:26.466777 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:51:26.466777 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:51:26.466777 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:51:26.466777 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:51:26.466777 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:51:26.466777 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17168892-79e0-4148-94f8-9034d13d060c could not be found. Aug 12 11:51:26.466777 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:26.466777 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:51:26.466777 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:26.466777 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:26.466777 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:51:26.466777 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:51:26.466777 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:51:26.466777 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:51:26.466777 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:51:26.467974 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:51:26.467974 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:51:26.467974 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:51:26.467974 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:51:26.467974 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:51:26.467974 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:51:26.467974 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:51:26.467974 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17168892-79e0-4148-94f8-9034d13d060c could not be found. Aug 12 11:51:26.467974 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:26.467974 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:51:26.467974 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:26.467974 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:26.467974 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:51:26.467974 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:51:26.467974 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:51:26.467974 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:51:26.467974 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17168892-79e0-4148-94f8-9034d13d060c could not be found. Aug 12 11:51:26.467974 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:26.468944 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-bee2042f-5145-431d-9fd0-b52e905a8e00 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Returning 404 to user: Instance 17168892-79e0-4148-94f8-9034d13d060c could not be found. {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:51:26.468944 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-bee2042f-5145-431d-9fd0-b52e905a8e00 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 404 len: 111 microversion: 2.1 time: 0.033402 Aug 12 11:51:26.468944 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 137/273] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:26 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:51:26.577756 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-1747f887-6554-42c8-b40b-e3388250e314 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:26.579969 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-1747f887-6554-42c8-b40b-e3388250e314 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:26.585760 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1747f887-6554-42c8-b40b-e3388250e314 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:26.586241 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1747f887-6554-42c8-b40b-e3388250e314 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:26.586699 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1747f887-6554-42c8-b40b-e3388250e314 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:26.587392 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1747f887-6554-42c8-b40b-e3388250e314 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:26.587844 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1747f887-6554-42c8-b40b-e3388250e314 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:26.588823 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1747f887-6554-42c8-b40b-e3388250e314 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:26.676706 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-86241fb0-bd13-49eb-ae8a-ddad9eeb47e7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:26.677347 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-86241fb0-bd13-49eb-ae8a-ddad9eeb47e7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:26.684415 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86241fb0-bd13-49eb-ae8a-ddad9eeb47e7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:26.684906 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86241fb0-bd13-49eb-ae8a-ddad9eeb47e7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:26.685341 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86241fb0-bd13-49eb-ae8a-ddad9eeb47e7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:26.686040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86241fb0-bd13-49eb-ae8a-ddad9eeb47e7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:26.686491 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86241fb0-bd13-49eb-ae8a-ddad9eeb47e7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:26.686961 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86241fb0-bd13-49eb-ae8a-ddad9eeb47e7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:26.734779 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.wsgi [None req-1747f887-6554-42c8-b40b-e3388250e314 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] HTTP exception thrown: Instance 17168892-79e0-4148-94f8-9034d13d060c could not be found. Aug 12 11:51:26.739453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-1747f887-6554-42c8-b40b-e3388250e314 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Request method failure captured: Aug 12 11:51:26.739453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c/os-volume_attachments HTTP/1.1 Aug 12 11:51:26.739453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 11:51:26.739453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 11:51:26.739453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 11:51:26.739453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 0 Aug 12 11:51:26.739453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 11:51:26.739453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 11:51:26.739453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 11:51:26.739453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 11:51:26.739453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9j5libPhc7ZYZoha4BsbMnnXGyUIa1LdFBpNhEqtQ1zdnMcNrakomJrpRGowRLWcGu9T3_1wC5XiU-Br_-_sNG6ntVTf-hYWHL1lUDk18FEY6-uaCY4pn0E6k-kKKjtemGhz7AnuwW8jDIrFbLmPZJV5Xioo-P-0OKIEPfZmUpA4odA Aug 12 11:51:26.739453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 11:51:26.739453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 11:51:26.739453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 11:51:26.739453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 11:51:26.739453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 11:51:26.739453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 11:51:26.739453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: 06451ebec8a947829019e1fea6636bc6 Aug 12 11:51:26.739453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-DeleteServersTestJSON-792612196 Aug 12 11:51:26.739453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 11:51:26.739453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 11:51:26.740938 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_06451ebec8a947829019e1fea6636bc6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/06451ebec8a947829019e1fea6636bc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/06451ebec8a947829019e1fea6636bc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/06451ebec8a947829019e1fea6636bc6"}]}] Aug 12 11:51:26.740938 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-DeleteServersTestJSON-792612196 Aug 12 11:51:26.740938 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: 06451ebec8a947829019e1fea6636bc6 Aug 12 11:51:26.740938 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-DeleteServersTestJSON-792612196 Aug 12 11:51:26.740938 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-DeleteServersTestJSON-792612196-project Aug 12 11:51:26.740938 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 11:51:26.740938 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 11:51:26.740938 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: 134faab760d04e3ba537619281c316c9 Aug 12 11:51:26.740938 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-DeleteServersTestJSON-792612196-project Aug 12 11:51:26.740938 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: > Aug 12 11:51:26.740938 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Instance 17168892-79e0-4148-94f8-9034d13d060c could not be found. Aug 12 11:51:26.740938 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'server_id': '17168892-79e0-4148-94f8-9034d13d060c'} Aug 12 11:51:26.741622 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:51:26.741622 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:26.741622 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:51:26.741622 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:51:26.741622 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:51:26.741622 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:51:26.741622 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:51:26.741622 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:51:26.741622 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:51:26.741622 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:51:26.741622 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17168892-79e0-4148-94f8-9034d13d060c could not be found. Aug 12 11:51:26.741622 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:51:26.741622 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:51:26.741622 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:51:26.741622 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:26.741622 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:51:26.741622 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:51:26.741622 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:51:26.741622 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:51:26.741622 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:51:26.742689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:51:26.742689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 12 11:51:26.742689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 11:51:26.742689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 12 11:51:26.742689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 11:51:26.742689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 12 11:51:26.742689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 12 11:51:26.742689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:51:26.742689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:51:26.742689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17168892-79e0-4148-94f8-9034d13d060c could not be found. Aug 12 11:51:26.742689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:51:26.742689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:51:26.742689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:51:26.742689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:26.742689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:51:26.742689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:51:26.742689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:51:26.742689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:51:26.742689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17168892-79e0-4148-94f8-9034d13d060c could not be found. Aug 12 11:51:26.742689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:51:26.743756 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-1747f887-6554-42c8-b40b-e3388250e314 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Returning 404 to user: Instance 17168892-79e0-4148-94f8-9034d13d060c could not be found. {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:51:26.743756 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-1747f887-6554-42c8-b40b-e3388250e314 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.167032 Aug 12 11:51:26.743756 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 137/274] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Aug 12 11:51:26 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c/os-volume_attachments => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:51:26.820615 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-86241fb0-bd13-49eb-ae8a-ddad9eeb47e7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:26.828774 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-86241fb0-bd13-49eb-ae8a-ddad9eeb47e7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.156014 Aug 12 11:51:26.829329 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 138/275] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:26 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:51:27.391550 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d1c28e27-9787-43b5-b0c1-769eee22bffc tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:27.392157 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d1c28e27-9787-43b5-b0c1-769eee22bffc tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:27.398708 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d1c28e27-9787-43b5-b0c1-769eee22bffc tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:27.399194 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d1c28e27-9787-43b5-b0c1-769eee22bffc tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:27.399619 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d1c28e27-9787-43b5-b0c1-769eee22bffc tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:27.400296 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d1c28e27-9787-43b5-b0c1-769eee22bffc tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:27.401238 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d1c28e27-9787-43b5-b0c1-769eee22bffc tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:27.401654 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d1c28e27-9787-43b5-b0c1-769eee22bffc tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:27.460288 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d1c28e27-9787-43b5-b0c1-769eee22bffc tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:27.467966 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-d1c28e27-9787-43b5-b0c1-769eee22bffc tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1300 microversion: 2.1 time: 0.080300 Aug 12 11:51:27.468502 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 138/276] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:27 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1300 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:27.849722 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-d0bb3079-9128-42e3-84f9-17c4cebe1b7b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:27.850333 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-d0bb3079-9128-42e3-84f9-17c4cebe1b7b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:27.856334 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d0bb3079-9128-42e3-84f9-17c4cebe1b7b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:27.856819 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d0bb3079-9128-42e3-84f9-17c4cebe1b7b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:27.857254 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d0bb3079-9128-42e3-84f9-17c4cebe1b7b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:27.857937 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d0bb3079-9128-42e3-84f9-17c4cebe1b7b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:27.858388 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d0bb3079-9128-42e3-84f9-17c4cebe1b7b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:27.858840 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d0bb3079-9128-42e3-84f9-17c4cebe1b7b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:27.987556 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-d0bb3079-9128-42e3-84f9-17c4cebe1b7b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:27.995039 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-d0bb3079-9128-42e3-84f9-17c4cebe1b7b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.149251 Aug 12 11:51:27.995593 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 139/277] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:27 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:28.488639 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-fbe5d1e9-76ac-44cb-bce2-790a0f60da24 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:28.489237 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-fbe5d1e9-76ac-44cb-bce2-790a0f60da24 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:28.495586 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fbe5d1e9-76ac-44cb-bce2-790a0f60da24 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:28.496054 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fbe5d1e9-76ac-44cb-bce2-790a0f60da24 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:28.496479 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fbe5d1e9-76ac-44cb-bce2-790a0f60da24 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:28.497150 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fbe5d1e9-76ac-44cb-bce2-790a0f60da24 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:28.497594 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fbe5d1e9-76ac-44cb-bce2-790a0f60da24 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:28.498012 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fbe5d1e9-76ac-44cb-bce2-790a0f60da24 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:28.527498 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fbe5d1e9-76ac-44cb-bce2-790a0f60da24 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:28.527890 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fbe5d1e9-76ac-44cb-bce2-790a0f60da24 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:28.528313 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fbe5d1e9-76ac-44cb-bce2-790a0f60da24 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:28.528744 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.objects.instance [None req-fbe5d1e9-76ac-44cb-bce2-790a0f60da24 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lazy-loading 'fault' on Instance uuid 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 {{(pid=132282) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:51:28.568529 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-fbe5d1e9-76ac-44cb-bce2-790a0f60da24 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0b8111307e47c4acc860603f84c297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5b4b400190480aacaa5d0f28aff646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:28.575956 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-fbe5d1e9-76ac-44cb-bce2-790a0f60da24 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 200 len: 1305 microversion: 2.1 time: 0.091171 Aug 12 11:51:28.576504 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 139/278] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:28 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 1305 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:28.993032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-bfecd80f-4d34-4a89-a731-35a1207f3f68 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:28.993556 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-bfecd80f-4d34-4a89-a731-35a1207f3f68 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:28.999955 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bfecd80f-4d34-4a89-a731-35a1207f3f68 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:29.000489 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bfecd80f-4d34-4a89-a731-35a1207f3f68 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:29.000865 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bfecd80f-4d34-4a89-a731-35a1207f3f68 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:29.001546 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bfecd80f-4d34-4a89-a731-35a1207f3f68 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:29.001996 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bfecd80f-4d34-4a89-a731-35a1207f3f68 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:29.002420 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bfecd80f-4d34-4a89-a731-35a1207f3f68 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:29.016091 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-f156376b-78ec-4583-9af3-e276a7e74868 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:29.017015 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-f156376b-78ec-4583-9af3-e276a7e74868 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:29.017613 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.wsgi [None req-bfecd80f-4d34-4a89-a731-35a1207f3f68 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] HTTP exception thrown: Instance 17168892-79e0-4148-94f8-9034d13d060c could not be found. Aug 12 11:51:29.019365 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-bfecd80f-4d34-4a89-a731-35a1207f3f68 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Request method failure captured: Aug 12 11:51:29.019365 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: DELETE /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c HTTP/1.1 Aug 12 11:51:29.019365 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 11:51:29.019365 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 11:51:29.019365 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 11:51:29.019365 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 0 Aug 12 11:51:29.019365 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 11:51:29.019365 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 11:51:29.019365 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 11:51:29.019365 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 11:51:29.019365 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9j5libPhc7ZYZoha4BsbMnnXGyUIa1LdFBpNhEqtQ1zdnMcNrakomJrpRGowRLWcGu9T3_1wC5XiU-Br_-_sNG6ntVTf-hYWHL1lUDk18FEY6-uaCY4pn0E6k-kKKjtemGhz7AnuwW8jDIrFbLmPZJV5Xioo-P-0OKIEPfZmUpA4odA Aug 12 11:51:29.019365 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 11:51:29.019365 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 11:51:29.019365 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 11:51:29.019365 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 11:51:29.019365 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 11:51:29.019365 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 11:51:29.019365 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: 06451ebec8a947829019e1fea6636bc6 Aug 12 11:51:29.019365 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-DeleteServersTestJSON-792612196 Aug 12 11:51:29.019365 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 11:51:29.019365 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 11:51:29.020765 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_06451ebec8a947829019e1fea6636bc6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/06451ebec8a947829019e1fea6636bc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/06451ebec8a947829019e1fea6636bc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/06451ebec8a947829019e1fea6636bc6"}]}] Aug 12 11:51:29.020765 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-DeleteServersTestJSON-792612196 Aug 12 11:51:29.020765 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: 06451ebec8a947829019e1fea6636bc6 Aug 12 11:51:29.020765 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-DeleteServersTestJSON-792612196 Aug 12 11:51:29.020765 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-DeleteServersTestJSON-792612196-project Aug 12 11:51:29.020765 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 11:51:29.020765 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 11:51:29.020765 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: 134faab760d04e3ba537619281c316c9 Aug 12 11:51:29.020765 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-DeleteServersTestJSON-792612196-project Aug 12 11:51:29.020765 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: > Aug 12 11:51:29.020765 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Instance 17168892-79e0-4148-94f8-9034d13d060c could not be found. Aug 12 11:51:29.020765 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'id': '17168892-79e0-4148-94f8-9034d13d060c'} Aug 12 11:51:29.021535 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:51:29.021535 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:29.021535 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:51:29.021535 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:51:29.021535 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:51:29.021535 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:51:29.021535 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:51:29.021535 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:51:29.021535 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:51:29.021535 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:51:29.021535 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17168892-79e0-4148-94f8-9034d13d060c could not be found. Aug 12 11:51:29.021535 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:29.021535 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:51:29.021535 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:29.021535 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:29.021535 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:51:29.021535 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:51:29.021535 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:51:29.021535 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:51:29.021535 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:51:29.022792 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:51:29.022792 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 11:51:29.022792 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 11:51:29.022792 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 11:51:29.022792 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 11:51:29.022792 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:51:29.022792 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:51:29.022792 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:51:29.022792 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:51:29.022792 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17168892-79e0-4148-94f8-9034d13d060c could not be found. Aug 12 11:51:29.022792 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:29.022792 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:51:29.022792 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:29.022792 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:29.022792 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:51:29.022792 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:51:29.022792 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:51:29.022792 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:51:29.022792 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17168892-79e0-4148-94f8-9034d13d060c could not be found. Aug 12 11:51:29.022792 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:29.024095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f156376b-78ec-4583-9af3-e276a7e74868 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:29.024095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f156376b-78ec-4583-9af3-e276a7e74868 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:29.024436 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f156376b-78ec-4583-9af3-e276a7e74868 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:29.024911 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-bfecd80f-4d34-4a89-a731-35a1207f3f68 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Returning 404 to user: Instance 17168892-79e0-4148-94f8-9034d13d060c could not be found. {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:51:29.025259 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f156376b-78ec-4583-9af3-e276a7e74868 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:29.026255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-bfecd80f-4d34-4a89-a731-35a1207f3f68 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "DELETE /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 404 len: 111 microversion: 2.1 time: 0.037107 Aug 12 11:51:29.026553 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f156376b-78ec-4583-9af3-e276a7e74868 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:29.026888 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 140/279] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Aug 12 11:51:28 2022] DELETE /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:51:29.030579 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f156376b-78ec-4583-9af3-e276a7e74868 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:29.034997 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-2c73986e-e3d3-4723-8e6e-7f6540991d32 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:29.035605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-2c73986e-e3d3-4723-8e6e-7f6540991d32 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] [instance: 17168892-79e0-4148-94f8-9034d13d060c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:29.044169 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2c73986e-e3d3-4723-8e6e-7f6540991d32 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:29.044663 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2c73986e-e3d3-4723-8e6e-7f6540991d32 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:29.045095 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2c73986e-e3d3-4723-8e6e-7f6540991d32 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:29.046199 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2c73986e-e3d3-4723-8e6e-7f6540991d32 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:29.046694 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2c73986e-e3d3-4723-8e6e-7f6540991d32 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:29.047588 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2c73986e-e3d3-4723-8e6e-7f6540991d32 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:29.063228 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.wsgi [None req-2c73986e-e3d3-4723-8e6e-7f6540991d32 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] HTTP exception thrown: Instance 17168892-79e0-4148-94f8-9034d13d060c could not be found. Aug 12 11:51:29.064736 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-2c73986e-e3d3-4723-8e6e-7f6540991d32 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Request method failure captured: Aug 12 11:51:29.064736 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c HTTP/1.1 Aug 12 11:51:29.064736 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 11:51:29.064736 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 11:51:29.064736 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 11:51:29.064736 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 0 Aug 12 11:51:29.064736 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 11:51:29.064736 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 11:51:29.064736 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 11:51:29.064736 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 11:51:29.064736 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9j5libPhc7ZYZoha4BsbMnnXGyUIa1LdFBpNhEqtQ1zdnMcNrakomJrpRGowRLWcGu9T3_1wC5XiU-Br_-_sNG6ntVTf-hYWHL1lUDk18FEY6-uaCY4pn0E6k-kKKjtemGhz7AnuwW8jDIrFbLmPZJV5Xioo-P-0OKIEPfZmUpA4odA Aug 12 11:51:29.064736 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 11:51:29.064736 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 11:51:29.064736 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 11:51:29.064736 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 11:51:29.064736 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 11:51:29.064736 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 11:51:29.064736 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: 06451ebec8a947829019e1fea6636bc6 Aug 12 11:51:29.064736 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-DeleteServersTestJSON-792612196 Aug 12 11:51:29.064736 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 11:51:29.064736 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 11:51:29.066151 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_06451ebec8a947829019e1fea6636bc6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/06451ebec8a947829019e1fea6636bc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/06451ebec8a947829019e1fea6636bc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/06451ebec8a947829019e1fea6636bc6"}]}] Aug 12 11:51:29.066151 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-DeleteServersTestJSON-792612196 Aug 12 11:51:29.066151 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: 06451ebec8a947829019e1fea6636bc6 Aug 12 11:51:29.066151 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-DeleteServersTestJSON-792612196 Aug 12 11:51:29.066151 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-DeleteServersTestJSON-792612196-project Aug 12 11:51:29.066151 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 11:51:29.066151 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 11:51:29.066151 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: 134faab760d04e3ba537619281c316c9 Aug 12 11:51:29.066151 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-DeleteServersTestJSON-792612196-project Aug 12 11:51:29.066151 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: > Aug 12 11:51:29.066151 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Instance 17168892-79e0-4148-94f8-9034d13d060c could not be found. Aug 12 11:51:29.066151 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'id': '17168892-79e0-4148-94f8-9034d13d060c'} Aug 12 11:51:29.066918 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:51:29.066918 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:29.066918 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:51:29.066918 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:51:29.066918 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:51:29.066918 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:51:29.066918 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:51:29.066918 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:51:29.066918 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:51:29.066918 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:51:29.066918 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17168892-79e0-4148-94f8-9034d13d060c could not be found. Aug 12 11:51:29.066918 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:29.066918 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:51:29.066918 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:29.066918 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:29.066918 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:51:29.066918 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:51:29.066918 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:51:29.066918 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:51:29.066918 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:51:29.067954 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:51:29.067954 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:51:29.067954 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:51:29.067954 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:51:29.067954 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:51:29.067954 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:51:29.067954 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:51:29.067954 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17168892-79e0-4148-94f8-9034d13d060c could not be found. Aug 12 11:51:29.067954 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:29.067954 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:51:29.067954 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:29.067954 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:29.067954 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:51:29.067954 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:51:29.067954 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:51:29.067954 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:51:29.067954 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17168892-79e0-4148-94f8-9034d13d060c could not be found. Aug 12 11:51:29.067954 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:29.068896 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-2c73986e-e3d3-4723-8e6e-7f6540991d32 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] Returning 404 to user: Instance 17168892-79e0-4148-94f8-9034d13d060c could not be found. {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:51:29.068896 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-2c73986e-e3d3-4723-8e6e-7f6540991d32 tempest-DeleteServersTestJSON-792612196 tempest-DeleteServersTestJSON-792612196-project] 10.222.0.42 "GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c" status: 404 len: 111 microversion: 2.1 time: 0.037021 Aug 12 11:51:29.069513 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 141/280] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:29 2022] GET /compute/v2.1/servers/17168892-79e0-4148-94f8-9034d13d060c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 11:51:29.174137 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-f156376b-78ec-4583-9af3-e276a7e74868 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:29.181679 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-f156376b-78ec-4583-9af3-e276a7e74868 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.169539 Aug 12 11:51:29.182225 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 140/281] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:29 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:51:29.600255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-23cd1942-863e-462e-a3a3-44348a0ee746 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:29.600892 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-23cd1942-863e-462e-a3a3-44348a0ee746 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] [instance: 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:29.607392 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-23cd1942-863e-462e-a3a3-44348a0ee746 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:29.608113 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-23cd1942-863e-462e-a3a3-44348a0ee746 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:29.608721 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-23cd1942-863e-462e-a3a3-44348a0ee746 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:29.609433 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-23cd1942-863e-462e-a3a3-44348a0ee746 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:29.609888 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-23cd1942-863e-462e-a3a3-44348a0ee746 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:29.610279 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-23cd1942-863e-462e-a3a3-44348a0ee746 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:29.624911 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.wsgi [None req-23cd1942-863e-462e-a3a3-44348a0ee746 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] HTTP exception thrown: Instance 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 could not be found. Aug 12 11:51:29.627109 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-23cd1942-863e-462e-a3a3-44348a0ee746 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Request method failure captured: Aug 12 11:51:29.627109 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 HTTP/1.1 Aug 12 11:51:29.627109 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 11:51:29.627109 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 11:51:29.627109 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 11:51:29.627109 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 0 Aug 12 11:51:29.627109 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 11:51:29.627109 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 11:51:29.627109 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 11:51:29.627109 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 11:51:29.627109 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9j6Yu0gIUsLWBCxLJ6hr-pf7cugXjMur0X0AM7FbWp-fybtAGDse9-Oml8BQiHUhE40pKtHDLx30E0FxlQgpESzpu-hXtOV_O4DyGy4d2ImR4KpqBt79NnsvgIdII7yKE2R1s0LDJW2Zvty7ztvafUuJFKp0LpCyjYoCMtacF4Jq-lI Aug 12 11:51:29.627109 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 11:51:29.627109 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 11:51:29.627109 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 11:51:29.627109 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 11:51:29.627109 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 11:51:29.627109 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 11:51:29.627109 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: 3c5b4b400190480aacaa5d0f28aff646 Aug 12 11:51:29.627109 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-VolumesNegativeTest-806450365 Aug 12 11:51:29.627109 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 11:51:29.627109 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 11:51:29.628620 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3c5b4b400190480aacaa5d0f28aff646", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3c5b4b400190480aacaa5d0f28aff646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c5b4b400190480aacaa5d0f28aff646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c5b4b400190480aacaa5d0f28aff646"}]}] Aug 12 11:51:29.628620 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-VolumesNegativeTest-806450365 Aug 12 11:51:29.628620 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: 3c5b4b400190480aacaa5d0f28aff646 Aug 12 11:51:29.628620 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-VolumesNegativeTest-806450365 Aug 12 11:51:29.628620 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-VolumesNegativeTest-806450365-project Aug 12 11:51:29.628620 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 11:51:29.628620 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 11:51:29.628620 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: ac0b8111307e47c4acc860603f84c297 Aug 12 11:51:29.628620 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-VolumesNegativeTest-806450365-project Aug 12 11:51:29.628620 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: > Aug 12 11:51:29.628620 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Instance 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 could not be found. Aug 12 11:51:29.628620 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'id': '666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8'} Aug 12 11:51:29.629605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:51:29.629605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:29.629605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:51:29.629605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:51:29.629605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:51:29.629605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:51:29.629605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:51:29.629605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:51:29.629605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:51:29.629605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:51:29.629605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 could not be found. Aug 12 11:51:29.629605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:29.629605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:51:29.629605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:29.629605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:29.629605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:51:29.629605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:51:29.629605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:51:29.629605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:51:29.629605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:51:29.630929 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:51:29.630929 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:51:29.630929 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:51:29.630929 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:51:29.630929 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:51:29.630929 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:51:29.630929 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:51:29.630929 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 could not be found. Aug 12 11:51:29.630929 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:29.630929 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:51:29.630929 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:29.630929 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:29.630929 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:51:29.630929 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:51:29.630929 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:51:29.630929 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:51:29.630929 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 could not be found. Aug 12 11:51:29.630929 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:29.648636 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-23cd1942-863e-462e-a3a3-44348a0ee746 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] Returning 404 to user: Instance 666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 could not be found. {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:51:29.649663 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-23cd1942-863e-462e-a3a3-44348a0ee746 tempest-VolumesNegativeTest-806450365 tempest-VolumesNegativeTest-806450365-project] 10.222.0.42 "GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8" status: 404 len: 111 microversion: 2.1 time: 0.056047 Aug 12 11:51:29.651209 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 142/282] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:29 2022] GET /compute/v2.1/servers/666a2fd3-bcd9-4f4a-9de6-33c4bfdf69e8 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:51:30.202758 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-279f51db-68ab-4ee3-80c2-d34d0960338c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:30.203575 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-279f51db-68ab-4ee3-80c2-d34d0960338c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:30.209983 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-279f51db-68ab-4ee3-80c2-d34d0960338c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:30.210469 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-279f51db-68ab-4ee3-80c2-d34d0960338c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:30.211116 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-279f51db-68ab-4ee3-80c2-d34d0960338c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:30.211861 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-279f51db-68ab-4ee3-80c2-d34d0960338c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:30.212428 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-279f51db-68ab-4ee3-80c2-d34d0960338c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:30.212779 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-279f51db-68ab-4ee3-80c2-d34d0960338c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:30.373150 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-279f51db-68ab-4ee3-80c2-d34d0960338c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:30.382251 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-279f51db-68ab-4ee3-80c2-d34d0960338c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.183173 Aug 12 11:51:30.383090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 141/283] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:30 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:31.410802 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-637df6c4-e5b4-443e-bf87-7a2fd4e64793 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:31.411910 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-637df6c4-e5b4-443e-bf87-7a2fd4e64793 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:31.419638 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-637df6c4-e5b4-443e-bf87-7a2fd4e64793 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:31.420210 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-637df6c4-e5b4-443e-bf87-7a2fd4e64793 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:31.420885 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-637df6c4-e5b4-443e-bf87-7a2fd4e64793 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:31.421825 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-637df6c4-e5b4-443e-bf87-7a2fd4e64793 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:31.422460 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-637df6c4-e5b4-443e-bf87-7a2fd4e64793 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:31.423219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-637df6c4-e5b4-443e-bf87-7a2fd4e64793 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:31.592785 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-637df6c4-e5b4-443e-bf87-7a2fd4e64793 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:31.604049 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-637df6c4-e5b4-443e-bf87-7a2fd4e64793 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.197140 Aug 12 11:51:31.604646 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 143/284] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:31 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:32.635314 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-0ae332fc-5b4a-44bc-802d-59c53728ef92 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:32.637399 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-0ae332fc-5b4a-44bc-802d-59c53728ef92 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:32.645578 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0ae332fc-5b4a-44bc-802d-59c53728ef92 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:32.646381 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0ae332fc-5b4a-44bc-802d-59c53728ef92 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:32.647412 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0ae332fc-5b4a-44bc-802d-59c53728ef92 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:32.648334 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0ae332fc-5b4a-44bc-802d-59c53728ef92 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:32.649607 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0ae332fc-5b4a-44bc-802d-59c53728ef92 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:32.651063 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0ae332fc-5b4a-44bc-802d-59c53728ef92 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:32.939430 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-0ae332fc-5b4a-44bc-802d-59c53728ef92 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:32.946954 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-0ae332fc-5b4a-44bc-802d-59c53728ef92 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.324936 Aug 12 11:51:32.959394 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 142/285] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:32 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:33.968706 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-0f81ff6f-6d94-4c62-9523-ab2122cb9e1a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:33.969319 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-0f81ff6f-6d94-4c62-9523-ab2122cb9e1a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:33.976416 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0f81ff6f-6d94-4c62-9523-ab2122cb9e1a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:33.976840 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0f81ff6f-6d94-4c62-9523-ab2122cb9e1a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:33.977271 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0f81ff6f-6d94-4c62-9523-ab2122cb9e1a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:33.978147 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0f81ff6f-6d94-4c62-9523-ab2122cb9e1a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:33.978669 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0f81ff6f-6d94-4c62-9523-ab2122cb9e1a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:33.979102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0f81ff6f-6d94-4c62-9523-ab2122cb9e1a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:34.200602 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-0f81ff6f-6d94-4c62-9523-ab2122cb9e1a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:34.211235 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-0f81ff6f-6d94-4c62-9523-ab2122cb9e1a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.245857 Aug 12 11:51:34.212662 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 144/286] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:33 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:34.554150 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-f6b87199-5699-473c-af65-419e8e1ee8bc tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] Action: 'create', calling method: .version_select at 0x7f3e5869eaf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1370061030"}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:51:34.929940 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-f6b87199-5699-473c-af65-419e8e1ee8bc tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.640371 Aug 12 11:51:34.931095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 143/287] 10.222.0.42 () {60 vars in 1155 bytes} [Fri Aug 12 11:51:34 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 642 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 12 11:51:34.945136 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-df1eafb8-b002-4463-9742-7369aa5f531a tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] Calling method '.version_select at 0x7f3e58389dc0>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:35.009220 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-df1eafb8-b002-4463-9742-7369aa5f531a tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3c82d0eb-4697-4644-939f-c06bfd88fe3f" status: 200 len: 345 microversion: 2.1 time: 0.069846 Aug 12 11:51:35.012105 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 145/288] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Aug 12 11:51:34 2022] GET /compute/v2.1/os-volumes/3c82d0eb-4697-4644-939f-c06bfd88fe3f => generated 345 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:51:35.236929 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-7b450fbd-7648-4d81-bff3-9349a629d19f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:35.237458 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-7b450fbd-7648-4d81-bff3-9349a629d19f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:35.244562 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7b450fbd-7648-4d81-bff3-9349a629d19f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:35.245039 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7b450fbd-7648-4d81-bff3-9349a629d19f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:35.245760 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7b450fbd-7648-4d81-bff3-9349a629d19f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:35.246778 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7b450fbd-7648-4d81-bff3-9349a629d19f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:35.247393 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7b450fbd-7648-4d81-bff3-9349a629d19f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:35.247818 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7b450fbd-7648-4d81-bff3-9349a629d19f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:35.382699 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-7b450fbd-7648-4d81-bff3-9349a629d19f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:35.390589 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-7b450fbd-7648-4d81-bff3-9349a629d19f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.158835 Aug 12 11:51:35.391185 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 144/289] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:35 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:36.026001 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-db1fff28-8324-4346-b5ff-57659bf6fc13 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] Calling method '.version_select at 0x7f3e584e6b80>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:36.072086 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-db1fff28-8324-4346-b5ff-57659bf6fc13 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3c82d0eb-4697-4644-939f-c06bfd88fe3f" status: 200 len: 345 microversion: 2.1 time: 0.050246 Aug 12 11:51:36.072641 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 146/290] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Aug 12 11:51:36 2022] GET /compute/v2.1/os-volumes/3c82d0eb-4697-4644-939f-c06bfd88fe3f => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:51:36.412159 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-85365672-6835-4d48-9987-ac179a7cf6b6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:36.412767 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-85365672-6835-4d48-9987-ac179a7cf6b6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:36.419293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-85365672-6835-4d48-9987-ac179a7cf6b6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:36.419766 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-85365672-6835-4d48-9987-ac179a7cf6b6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:36.420194 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-85365672-6835-4d48-9987-ac179a7cf6b6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:36.420876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-85365672-6835-4d48-9987-ac179a7cf6b6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:36.421324 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-85365672-6835-4d48-9987-ac179a7cf6b6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:36.421745 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-85365672-6835-4d48-9987-ac179a7cf6b6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:36.550535 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-85365672-6835-4d48-9987-ac179a7cf6b6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:36.558094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-85365672-6835-4d48-9987-ac179a7cf6b6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.149772 Aug 12 11:51:36.558671 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 145/291] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:36 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:37.086212 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-d23454c9-f0e8-4f36-961f-c2dce868ee60 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] Calling method '.version_select at 0x7f3e58393040>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:37.133548 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-d23454c9-f0e8-4f36-961f-c2dce868ee60 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3c82d0eb-4697-4644-939f-c06bfd88fe3f" status: 200 len: 346 microversion: 2.1 time: 0.051618 Aug 12 11:51:37.134106 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 147/292] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Aug 12 11:51:37 2022] GET /compute/v2.1/os-volumes/3c82d0eb-4697-4644-939f-c06bfd88fe3f => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:51:37.147188 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-797cd346-a1b3-478c-b3bc-fb45c58006ff tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] Action: 'create', calling method: .version_select at 0x7f3e584ec9d0>, body: {"snapshot": {"volume_id": "3c82d0eb-4697-4644-939f-c06bfd88fe3f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-623858827"}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:51:37.304065 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-797cd346-a1b3-478c-b3bc-fb45c58006ff tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.161081 Aug 12 11:51:37.304639 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 146/293] 10.222.0.42 () {60 vars in 1162 bytes} [Fri Aug 12 11:51:37 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:51:37.316257 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-381a5fad-a908-4097-ae51-3298de9d7c7c tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] Calling method '.version_select at 0x7f3e5a0a7ee0>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:37.345933 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-381a5fad-a908-4097-ae51-3298de9d7c7c tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/71fb9755-d521-438b-b2bd-525c63586d32" status: 200 len: 286 microversion: 2.1 time: 0.033455 Aug 12 11:51:37.346499 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 148/294] 10.222.0.42 () {58 vars in 1251 bytes} [Fri Aug 12 11:51:37 2022] GET /compute/v2.1/os-snapshots/71fb9755-d521-438b-b2bd-525c63586d32 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:51:37.357045 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e697343d-83a4-474d-8b0a-f5442c11ba4a tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] Calling method '.version_select at 0x7f3e586404c0>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:37.390247 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e697343d-83a4-474d-8b0a-f5442c11ba4a tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.036886 Aug 12 11:51:37.390830 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 147/295] 10.222.0.42 () {58 vars in 1140 bytes} [Fri Aug 12 11:51:37 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:51:37.401345 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-7bef9ca3-bb0a-45b2-a5f2-8b885fa92398 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] Calling method '.version_select at 0x7f3e58389d30>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:37.429566 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-7bef9ca3-bb0a-45b2-a5f2-8b885fa92398 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/71fb9755-d521-438b-b2bd-525c63586d32" status: 200 len: 286 microversion: 2.1 time: 0.031831 Aug 12 11:51:37.430098 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 149/296] 10.222.0.42 () {58 vars in 1251 bytes} [Fri Aug 12 11:51:37 2022] GET /compute/v2.1/os-snapshots/71fb9755-d521-438b-b2bd-525c63586d32 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:51:37.578541 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-bf490b5e-aa62-4b22-b0b9-05293186e878 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:37.579246 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-bf490b5e-aa62-4b22-b0b9-05293186e878 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:37.586097 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bf490b5e-aa62-4b22-b0b9-05293186e878 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:37.586797 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bf490b5e-aa62-4b22-b0b9-05293186e878 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:37.587403 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bf490b5e-aa62-4b22-b0b9-05293186e878 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:37.588245 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bf490b5e-aa62-4b22-b0b9-05293186e878 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:37.588820 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bf490b5e-aa62-4b22-b0b9-05293186e878 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:37.589467 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bf490b5e-aa62-4b22-b0b9-05293186e878 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:37.717410 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-bf490b5e-aa62-4b22-b0b9-05293186e878 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:37.724758 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-bf490b5e-aa62-4b22-b0b9-05293186e878 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.150082 Aug 12 11:51:37.725309 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 148/297] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:37 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:38.443910 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-75b9cd09-9164-438f-8e82-aff694315f6f tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] Calling method '.version_select at 0x7f3e5836dd30>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:38.474362 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-75b9cd09-9164-438f-8e82-aff694315f6f tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/71fb9755-d521-438b-b2bd-525c63586d32" status: 200 len: 286 microversion: 2.1 time: 0.034635 Aug 12 11:51:38.474941 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 150/298] 10.222.0.42 () {58 vars in 1251 bytes} [Fri Aug 12 11:51:38 2022] GET /compute/v2.1/os-snapshots/71fb9755-d521-438b-b2bd-525c63586d32 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:51:38.745879 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-4e08ea4a-6a23-48d3-b21d-f46d32acc6c1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:38.746407 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-4e08ea4a-6a23-48d3-b21d-f46d32acc6c1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:38.752232 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4e08ea4a-6a23-48d3-b21d-f46d32acc6c1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:38.752712 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4e08ea4a-6a23-48d3-b21d-f46d32acc6c1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:38.753138 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4e08ea4a-6a23-48d3-b21d-f46d32acc6c1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:38.753808 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4e08ea4a-6a23-48d3-b21d-f46d32acc6c1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:38.754252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4e08ea4a-6a23-48d3-b21d-f46d32acc6c1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:38.754699 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4e08ea4a-6a23-48d3-b21d-f46d32acc6c1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:38.877930 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-4e08ea4a-6a23-48d3-b21d-f46d32acc6c1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:38.885249 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-4e08ea4a-6a23-48d3-b21d-f46d32acc6c1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.143259 Aug 12 11:51:38.885809 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 149/299] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:38 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:39.487485 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-45bbceb1-a7c7-480c-84b9-2990bf57defb tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] Calling method '.version_select at 0x7f3e58389700>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:39.518025 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-45bbceb1-a7c7-480c-84b9-2990bf57defb tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/71fb9755-d521-438b-b2bd-525c63586d32" status: 200 len: 286 microversion: 2.1 time: 0.034730 Aug 12 11:51:39.518584 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 151/300] 10.222.0.42 () {58 vars in 1251 bytes} [Fri Aug 12 11:51:39 2022] GET /compute/v2.1/os-snapshots/71fb9755-d521-438b-b2bd-525c63586d32 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:51:39.905202 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-adf955ec-fce2-4f7b-8d85-e01408cb0e42 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:39.905803 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-adf955ec-fce2-4f7b-8d85-e01408cb0e42 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:39.907801 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_api:SELECT=72 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:39.912999 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-adf955ec-fce2-4f7b-8d85-e01408cb0e42 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:39.913471 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-adf955ec-fce2-4f7b-8d85-e01408cb0e42 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:39.913901 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-adf955ec-fce2-4f7b-8d85-e01408cb0e42 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:39.914572 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-adf955ec-fce2-4f7b-8d85-e01408cb0e42 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:39.915043 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-adf955ec-fce2-4f7b-8d85-e01408cb0e42 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:39.915461 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-adf955ec-fce2-4f7b-8d85-e01408cb0e42 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:40.045562 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-adf955ec-fce2-4f7b-8d85-e01408cb0e42 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:40.052910 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-adf955ec-fce2-4f7b-8d85-e01408cb0e42 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.151551 Aug 12 11:51:40.053465 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 150/301] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:39 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:40.531171 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-92905d6c-68f3-41f6-9ede-5d85c113fcac tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] Calling method '.version_select at 0x7f3e5838ec10>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:40.559573 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-92905d6c-68f3-41f6-9ede-5d85c113fcac tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/71fb9755-d521-438b-b2bd-525c63586d32" status: 200 len: 286 microversion: 2.1 time: 0.033245 Aug 12 11:51:40.560126 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 152/302] 10.222.0.42 () {58 vars in 1251 bytes} [Fri Aug 12 11:51:40 2022] GET /compute/v2.1/os-snapshots/71fb9755-d521-438b-b2bd-525c63586d32 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:51:41.074385 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d225452a-d530-4d39-bb46-a51b3a152afa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:41.075017 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d225452a-d530-4d39-bb46-a51b3a152afa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:41.080992 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d225452a-d530-4d39-bb46-a51b3a152afa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:41.081469 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d225452a-d530-4d39-bb46-a51b3a152afa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:41.082181 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d225452a-d530-4d39-bb46-a51b3a152afa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:41.082898 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d225452a-d530-4d39-bb46-a51b3a152afa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:41.083347 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d225452a-d530-4d39-bb46-a51b3a152afa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:41.083761 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d225452a-d530-4d39-bb46-a51b3a152afa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:41.213863 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d225452a-d530-4d39-bb46-a51b3a152afa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:41.223742 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-d225452a-d530-4d39-bb46-a51b3a152afa tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.153519 Aug 12 11:51:41.224534 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 151/303] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:41 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:41.572571 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-1ed15ba1-7dc6-4dc3-8485-9ab13a551e44 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] Calling method '.version_select at 0x7f3e585df040>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:41.603729 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-1ed15ba1-7dc6-4dc3-8485-9ab13a551e44 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/71fb9755-d521-438b-b2bd-525c63586d32" status: 200 len: 287 microversion: 2.1 time: 0.035273 Aug 12 11:51:41.604518 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 153/304] 10.222.0.42 () {58 vars in 1251 bytes} [Fri Aug 12 11:51:41 2022] GET /compute/v2.1/os-snapshots/71fb9755-d521-438b-b2bd-525c63586d32 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:51:41.615436 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-79fd6dbe-9225-44e9-92ed-cf6ba6f17915 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] Calling method '.version_select at 0x7f3e586403a0>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:41.671821 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-79fd6dbe-9225-44e9-92ed-cf6ba6f17915 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/71fb9755-d521-438b-b2bd-525c63586d32" status: 202 len: 0 microversion: 2.1 time: 0.060064 Aug 12 11:51:41.672379 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 152/305] 10.222.0.42 () {58 vars in 1254 bytes} [Fri Aug 12 11:51:41 2022] DELETE /compute/v2.1/os-snapshots/71fb9755-d521-438b-b2bd-525c63586d32 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:51:41.680496 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-46d6c8f5-e8cc-4d19-899c-689e3e42a792 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] Calling method '.version_select at 0x7f3e5838e160>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:41.710342 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-46d6c8f5-e8cc-4d19-899c-689e3e42a792 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/71fb9755-d521-438b-b2bd-525c63586d32" status: 200 len: 286 microversion: 2.1 time: 0.033679 Aug 12 11:51:41.711070 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 154/306] 10.222.0.42 () {58 vars in 1251 bytes} [Fri Aug 12 11:51:41 2022] GET /compute/v2.1/os-snapshots/71fb9755-d521-438b-b2bd-525c63586d32 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:51:42.245637 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-5c70bc6f-bf0f-4efa-be6a-e972183c101a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:42.246245 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-5c70bc6f-bf0f-4efa-be6a-e972183c101a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:42.252009 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5c70bc6f-bf0f-4efa-be6a-e972183c101a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:42.252485 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5c70bc6f-bf0f-4efa-be6a-e972183c101a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:42.252951 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5c70bc6f-bf0f-4efa-be6a-e972183c101a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:42.253640 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5c70bc6f-bf0f-4efa-be6a-e972183c101a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:42.254091 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5c70bc6f-bf0f-4efa-be6a-e972183c101a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:42.254509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5c70bc6f-bf0f-4efa-be6a-e972183c101a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:42.283057 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=100 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:42.410908 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-5c70bc6f-bf0f-4efa-be6a-e972183c101a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:42.420804 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-5c70bc6f-bf0f-4efa-be6a-e972183c101a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.178593 Aug 12 11:51:42.421532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 153/307] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:42 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:42.724596 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-3782755f-5c9f-4682-abe8-b95af5ea2074 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] Calling method '.version_select at 0x7f3e58389820>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:42.752058 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.wsgi [None req-3782755f-5c9f-4682-abe8-b95af5ea2074 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] HTTP exception thrown: Snapshot 71fb9755-d521-438b-b2bd-525c63586d32 could not be found. Aug 12 11:51:42.755484 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-3782755f-5c9f-4682-abe8-b95af5ea2074 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] Request method failure captured: Aug 12 11:51:42.755484 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: GET /compute/v2.1/os-snapshots/71fb9755-d521-438b-b2bd-525c63586d32 HTTP/1.1 Aug 12 11:51:42.755484 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 11:51:42.755484 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 11:51:42.755484 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 11:51:42.755484 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 0 Aug 12 11:51:42.755484 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 11:51:42.755484 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 11:51:42.755484 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 11:51:42.755484 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 11:51:42.755484 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9j7GOxeGIIFRaUagx3tJg7kzBPQS2cxk3og2aVLgimTTH1090SH_5giPwfyU1y73oyU5R7SG-K5V1_b1YgmmYZ8EbLJylmuSH5aS-x4czAakx361z-Dp2ss8LUF4p4w3rd7ZOLjjDRcM0d68v7qBr1ObursQKyUF-HGRdXYLt3TZLEg Aug 12 11:51:42.755484 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 11:51:42.755484 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 11:51:42.755484 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 11:51:42.755484 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 11:51:42.755484 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 11:51:42.755484 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 11:51:42.755484 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: e5a7f5c2f3e34684bd5b8161ba77014c Aug 12 11:51:42.755484 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-474592928 Aug 12 11:51:42.755484 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 11:51:42.755484 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 11:51:42.756946 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e5a7f5c2f3e34684bd5b8161ba77014c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e5a7f5c2f3e34684bd5b8161ba77014c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5a7f5c2f3e34684bd5b8161ba77014c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5a7f5c2f3e34684bd5b8161ba77014c"}]}] Aug 12 11:51:42.756946 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-VolumesSnapshotsTestJSON-474592928 Aug 12 11:51:42.756946 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: e5a7f5c2f3e34684bd5b8161ba77014c Aug 12 11:51:42.756946 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-474592928 Aug 12 11:51:42.756946 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-VolumesSnapshotsTestJSON-474592928-project Aug 12 11:51:42.756946 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 11:51:42.756946 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 11:51:42.756946 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: 327a8f72755c4645a854d86d881de107 Aug 12 11:51:42.756946 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-VolumesSnapshotsTestJSON-474592928-project Aug 12 11:51:42.756946 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: Aug 12 11:51:42.756946 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Snapshot 71fb9755-d521-438b-b2bd-525c63586d32 could not be found. Aug 12 11:51:42.756946 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'id': '71fb9755-d521-438b-b2bd-525c63586d32'} Aug 12 11:51:42.756946 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:51:42.757822 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:42.757822 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 12 11:51:42.757822 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 12 11:51:42.757822 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 12 11:51:42.757822 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 12 11:51:42.757822 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 12 11:51:42.757822 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 12 11:51:42.757822 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 11:51:42.757822 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 11:51:42.757822 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 11:51:42.757822 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 11:51:42.757822 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 11:51:42.757822 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 11:51:42.757822 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 11:51:42.757822 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 11:51:42.757822 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 71fb9755-d521-438b-b2bd-525c63586d32 could not be found. (HTTP 404) (Request-ID: req-40a60ee9-0a37-4d5f-a4fc-c12b0abc7a58) Aug 12 11:51:42.757822 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:42.757822 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:51:42.759712 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:42.759712 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:42.759712 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 12 11:51:42.759712 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 12 11:51:42.759712 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 11:51:42.759712 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 11:51:42.759712 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 12 11:51:42.759712 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 12 11:51:42.759712 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 11:51:42.759712 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 11:51:42.759712 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 12 11:51:42.759712 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 12 11:51:42.759712 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 12 11:51:42.759712 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 12 11:51:42.759712 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 12 11:51:42.759712 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 12 11:51:42.759712 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 11:51:42.759712 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 11:51:42.759712 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 11:51:42.761028 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 11:51:42.761028 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 11:51:42.761028 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 11:51:42.761028 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 11:51:42.761028 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 11:51:42.761028 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 71fb9755-d521-438b-b2bd-525c63586d32 could not be found. Aug 12 11:51:42.761028 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:42.761028 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:51:42.761028 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:42.761028 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:42.761028 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:51:42.761028 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:51:42.761028 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:51:42.761028 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:51:42.761028 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 11:51:42.761028 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 11:51:42.761028 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:51:42.761028 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:51:42.761028 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 12 11:51:42.761028 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:51:42.762219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 71fb9755-d521-438b-b2bd-525c63586d32 could not be found. Aug 12 11:51:42.762219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:42.762219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:51:42.762219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:42.762219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:42.762219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:51:42.762219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:51:42.762219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:51:42.762219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:51:42.762219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 71fb9755-d521-438b-b2bd-525c63586d32 could not be found. Aug 12 11:51:42.762219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:42.762219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-3782755f-5c9f-4682-abe8-b95af5ea2074 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] Returning 404 to user: Snapshot 71fb9755-d521-438b-b2bd-525c63586d32 could not be found. {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:51:42.762219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-3782755f-5c9f-4682-abe8-b95af5ea2074 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/71fb9755-d521-438b-b2bd-525c63586d32" status: 404 len: 111 microversion: 2.1 time: 0.038883 Aug 12 11:51:42.763149 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 155/308] 10.222.0.42 () {58 vars in 1251 bytes} [Fri Aug 12 11:51:42 2022] GET /compute/v2.1/os-snapshots/71fb9755-d521-438b-b2bd-525c63586d32 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:51:42.768053 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-1824ad93-d793-4764-ad6c-700cf08ebdec tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] Calling method '.version_select at 0x7f3e58640820>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:42.831070 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-1824ad93-d793-4764-ad6c-700cf08ebdec tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/3c82d0eb-4697-4644-939f-c06bfd88fe3f" status: 202 len: 0 microversion: 2.1 time: 0.066775 Aug 12 11:51:42.831621 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 154/309] 10.222.0.42 () {58 vars in 1248 bytes} [Fri Aug 12 11:51:42 2022] DELETE /compute/v2.1/os-volumes/3c82d0eb-4697-4644-939f-c06bfd88fe3f => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:51:42.840443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-fba4fe47-a2d2-423b-88bf-c32b086c3adf tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] Calling method '.version_select at 0x7f3e58435430>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:42.891944 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-fba4fe47-a2d2-423b-88bf-c32b086c3adf tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3c82d0eb-4697-4644-939f-c06bfd88fe3f" status: 200 len: 345 microversion: 2.1 time: 0.055969 Aug 12 11:51:42.892557 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 156/310] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Aug 12 11:51:42 2022] GET /compute/v2.1/os-volumes/3c82d0eb-4697-4644-939f-c06bfd88fe3f => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:51:43.443028 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-621c8911-4337-4780-a67d-50ce090d9640 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:43.443660 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-621c8911-4337-4780-a67d-50ce090d9640 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:43.449926 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-621c8911-4337-4780-a67d-50ce090d9640 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:43.450410 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-621c8911-4337-4780-a67d-50ce090d9640 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:43.450875 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-621c8911-4337-4780-a67d-50ce090d9640 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:43.451564 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-621c8911-4337-4780-a67d-50ce090d9640 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:43.452037 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-621c8911-4337-4780-a67d-50ce090d9640 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:43.452480 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-621c8911-4337-4780-a67d-50ce090d9640 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:43.582166 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-621c8911-4337-4780-a67d-50ce090d9640 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:43.590204 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-621c8911-4337-4780-a67d-50ce090d9640 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.151052 Aug 12 11:51:43.590776 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 155/311] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:43 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:43.905734 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-1bdaf1a6-fddd-4951-b128-2523197d7f20 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] Calling method '.version_select at 0x7f3e58389160>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:43.935828 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.wsgi [None req-1bdaf1a6-fddd-4951-b128-2523197d7f20 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] HTTP exception thrown: Volume 3c82d0eb-4697-4644-939f-c06bfd88fe3f could not be found. Aug 12 11:51:43.937821 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-1bdaf1a6-fddd-4951-b128-2523197d7f20 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] Request method failure captured: Aug 12 11:51:43.937821 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: GET /compute/v2.1/os-volumes/3c82d0eb-4697-4644-939f-c06bfd88fe3f HTTP/1.1 Aug 12 11:51:43.937821 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 11:51:43.937821 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 11:51:43.937821 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 11:51:43.937821 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 0 Aug 12 11:51:43.937821 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 11:51:43.937821 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 11:51:43.937821 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 11:51:43.937821 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 11:51:43.937821 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9j7GOxeGIIFRaUagx3tJg7kzBPQS2cxk3og2aVLgimTTH1090SH_5giPwfyU1y73oyU5R7SG-K5V1_b1YgmmYZ8EbLJylmuSH5aS-x4czAakx361z-Dp2ss8LUF4p4w3rd7ZOLjjDRcM0d68v7qBr1ObursQKyUF-HGRdXYLt3TZLEg Aug 12 11:51:43.937821 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 11:51:43.937821 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 11:51:43.937821 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 11:51:43.937821 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 11:51:43.937821 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 11:51:43.937821 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 11:51:43.937821 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: e5a7f5c2f3e34684bd5b8161ba77014c Aug 12 11:51:43.937821 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-474592928 Aug 12 11:51:43.937821 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 11:51:43.937821 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 11:51:43.939259 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e5a7f5c2f3e34684bd5b8161ba77014c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e5a7f5c2f3e34684bd5b8161ba77014c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5a7f5c2f3e34684bd5b8161ba77014c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5a7f5c2f3e34684bd5b8161ba77014c"}]}] Aug 12 11:51:43.939259 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-VolumesSnapshotsTestJSON-474592928 Aug 12 11:51:43.939259 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: e5a7f5c2f3e34684bd5b8161ba77014c Aug 12 11:51:43.939259 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-474592928 Aug 12 11:51:43.939259 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-VolumesSnapshotsTestJSON-474592928-project Aug 12 11:51:43.939259 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 11:51:43.939259 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 11:51:43.939259 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: 327a8f72755c4645a854d86d881de107 Aug 12 11:51:43.939259 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-VolumesSnapshotsTestJSON-474592928-project Aug 12 11:51:43.939259 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: Aug 12 11:51:43.939259 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Volume 3c82d0eb-4697-4644-939f-c06bfd88fe3f could not be found. Aug 12 11:51:43.939259 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'id': '3c82d0eb-4697-4644-939f-c06bfd88fe3f'} Aug 12 11:51:43.939259 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:51:43.940154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:43.940154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 11:51:43.940154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 11:51:43.940154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 11:51:43.940154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 11:51:43.940154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 11:51:43.940154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 11:51:43.940154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 11:51:43.940154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 11:51:43.940154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 11:51:43.940154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 11:51:43.940154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 11:51:43.940154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 11:51:43.940154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 11:51:43.940154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 11:51:43.940154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3c82d0eb-4697-4644-939f-c06bfd88fe3f could not be found. (HTTP 404) (Request-ID: req-476520f8-6f1b-42b9-b3e4-02ec6f8ce4ec) Aug 12 11:51:43.940154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:43.940154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:51:43.940154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:43.941391 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:43.941391 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 12 11:51:43.941391 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 12 11:51:43.941391 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 11:51:43.941391 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 11:51:43.941391 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 11:51:43.941391 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 11:51:43.941391 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 11:51:43.941391 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 11:51:43.941391 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 11:51:43.941391 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 11:51:43.941391 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 11:51:43.941391 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 11:51:43.941391 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 11:51:43.941391 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 11:51:43.941391 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 11:51:43.941391 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 11:51:43.941391 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 11:51:43.941391 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 11:51:43.942512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 11:51:43.942512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 11:51:43.942512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 11:51:43.942512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 11:51:43.942512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3c82d0eb-4697-4644-939f-c06bfd88fe3f could not be found. Aug 12 11:51:43.942512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:43.942512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:51:43.942512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:43.942512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:43.942512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:51:43.942512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:51:43.942512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:51:43.942512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:51:43.942512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 11:51:43.942512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 11:51:43.942512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:51:43.942512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:51:43.942512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 12 11:51:43.942512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:51:43.943597 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3c82d0eb-4697-4644-939f-c06bfd88fe3f could not be found. Aug 12 11:51:43.943597 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:43.943597 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:51:43.943597 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:43.943597 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:43.943597 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:51:43.943597 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:51:43.943597 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:51:43.943597 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:51:43.943597 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3c82d0eb-4697-4644-939f-c06bfd88fe3f could not be found. Aug 12 11:51:43.943597 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:43.943597 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-1bdaf1a6-fddd-4951-b128-2523197d7f20 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] Returning 404 to user: Volume 3c82d0eb-4697-4644-939f-c06bfd88fe3f could not be found. {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:51:43.943597 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-1bdaf1a6-fddd-4951-b128-2523197d7f20 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3c82d0eb-4697-4644-939f-c06bfd88fe3f" status: 404 len: 109 microversion: 2.1 time: 0.037830 Aug 12 11:51:43.943597 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 157/312] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Aug 12 11:51:43 2022] GET /compute/v2.1/os-volumes/3c82d0eb-4697-4644-939f-c06bfd88fe3f => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:51:43.953596 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-f88ba5cd-384a-4087-a9fb-a2f037402b01 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] Calling method '.version_select at 0x7f3e586401f0>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:43.980361 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.wsgi [None req-f88ba5cd-384a-4087-a9fb-a2f037402b01 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] HTTP exception thrown: Volume 3c82d0eb-4697-4644-939f-c06bfd88fe3f could not be found. Aug 12 11:51:43.983669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-f88ba5cd-384a-4087-a9fb-a2f037402b01 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] Request method failure captured: Aug 12 11:51:43.983669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: DELETE /compute/v2.1/os-volumes/3c82d0eb-4697-4644-939f-c06bfd88fe3f HTTP/1.1 Aug 12 11:51:43.983669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 11:51:43.983669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 11:51:43.983669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 11:51:43.983669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 0 Aug 12 11:51:43.983669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 11:51:43.983669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 11:51:43.983669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 11:51:43.983669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 11:51:43.983669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9j7GOxeGIIFRaUagx3tJg7kzBPQS2cxk3og2aVLgimTTH1090SH_5giPwfyU1y73oyU5R7SG-K5V1_b1YgmmYZ8EbLJylmuSH5aS-x4czAakx361z-Dp2ss8LUF4p4w3rd7ZOLjjDRcM0d68v7qBr1ObursQKyUF-HGRdXYLt3TZLEg Aug 12 11:51:43.983669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 11:51:43.983669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 11:51:43.983669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 11:51:43.983669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 11:51:43.983669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 11:51:43.983669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 11:51:43.983669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: e5a7f5c2f3e34684bd5b8161ba77014c Aug 12 11:51:43.983669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-474592928 Aug 12 11:51:43.983669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 11:51:43.983669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 11:51:43.985244 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e5a7f5c2f3e34684bd5b8161ba77014c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e5a7f5c2f3e34684bd5b8161ba77014c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5a7f5c2f3e34684bd5b8161ba77014c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5a7f5c2f3e34684bd5b8161ba77014c"}]}] Aug 12 11:51:43.985244 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-VolumesSnapshotsTestJSON-474592928 Aug 12 11:51:43.985244 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: e5a7f5c2f3e34684bd5b8161ba77014c Aug 12 11:51:43.985244 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-474592928 Aug 12 11:51:43.985244 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-VolumesSnapshotsTestJSON-474592928-project Aug 12 11:51:43.985244 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 11:51:43.985244 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 11:51:43.985244 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: 327a8f72755c4645a854d86d881de107 Aug 12 11:51:43.985244 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-VolumesSnapshotsTestJSON-474592928-project Aug 12 11:51:43.985244 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: Aug 12 11:51:43.985244 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Volume 3c82d0eb-4697-4644-939f-c06bfd88fe3f could not be found. Aug 12 11:51:43.985244 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'id': '3c82d0eb-4697-4644-939f-c06bfd88fe3f'} Aug 12 11:51:43.985244 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:51:43.986105 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:43.986105 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 11:51:43.986105 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 11:51:43.986105 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 11:51:43.986105 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 11:51:43.986105 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 11:51:43.986105 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 11:51:43.986105 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 11:51:43.986105 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 11:51:43.986105 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 11:51:43.986105 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 11:51:43.986105 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 11:51:43.986105 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 11:51:43.986105 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 11:51:43.986105 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 11:51:43.986105 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3c82d0eb-4697-4644-939f-c06bfd88fe3f could not be found. (HTTP 404) (Request-ID: req-6b556451-7e58-42d4-b3c4-fd10dedbedb4) Aug 12 11:51:43.986105 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:51:43.986105 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:51:43.986105 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:51:43.987467 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:43.987467 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 12 11:51:43.987467 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 12 11:51:43.987467 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 11:51:43.987467 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 11:51:43.987467 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 11:51:43.987467 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 11:51:43.987467 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 11:51:43.987467 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 11:51:43.987467 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 11:51:43.987467 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 11:51:43.987467 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 11:51:43.987467 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 11:51:43.987467 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 11:51:43.987467 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 11:51:43.987467 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 11:51:43.987467 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 11:51:43.987467 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 11:51:43.987467 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 11:51:43.988616 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 11:51:43.988616 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 11:51:43.988616 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 11:51:43.988616 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 11:51:43.988616 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3c82d0eb-4697-4644-939f-c06bfd88fe3f could not be found. Aug 12 11:51:43.988616 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:51:43.988616 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:51:43.988616 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:51:43.988616 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:43.988616 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:51:43.988616 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:51:43.988616 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:51:43.988616 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:51:43.988616 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 11:51:43.988616 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 11:51:43.988616 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:51:43.988616 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:51:43.988616 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 12 11:51:43.988616 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:51:43.989829 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3c82d0eb-4697-4644-939f-c06bfd88fe3f could not be found. Aug 12 11:51:43.989829 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:51:43.989829 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:51:43.989829 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:51:43.989829 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:43.989829 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:51:43.989829 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:51:43.989829 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:51:43.989829 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:51:43.989829 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3c82d0eb-4697-4644-939f-c06bfd88fe3f could not be found. Aug 12 11:51:43.989829 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:51:43.989829 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-f88ba5cd-384a-4087-a9fb-a2f037402b01 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] Returning 404 to user: Volume 3c82d0eb-4697-4644-939f-c06bfd88fe3f could not be found. {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:51:43.989829 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-f88ba5cd-384a-4087-a9fb-a2f037402b01 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/3c82d0eb-4697-4644-939f-c06bfd88fe3f" status: 404 len: 109 microversion: 2.1 time: 0.035887 Aug 12 11:51:43.989829 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 156/313] 10.222.0.42 () {58 vars in 1248 bytes} [Fri Aug 12 11:51:43 2022] DELETE /compute/v2.1/os-volumes/3c82d0eb-4697-4644-939f-c06bfd88fe3f => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:51:43.990831 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:43.994882 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-2cb9b364-395e-4b12-a309-86230a5e39f0 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] Calling method '.version_select at 0x7f3e5836d670>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:44.024831 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.wsgi [None req-2cb9b364-395e-4b12-a309-86230a5e39f0 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] HTTP exception thrown: Volume 3c82d0eb-4697-4644-939f-c06bfd88fe3f could not be found. Aug 12 11:51:44.026912 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-2cb9b364-395e-4b12-a309-86230a5e39f0 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] Request method failure captured: Aug 12 11:51:44.026912 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: GET /compute/v2.1/os-volumes/3c82d0eb-4697-4644-939f-c06bfd88fe3f HTTP/1.1 Aug 12 11:51:44.026912 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 11:51:44.026912 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 11:51:44.026912 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 11:51:44.026912 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 0 Aug 12 11:51:44.026912 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 11:51:44.026912 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 11:51:44.026912 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 11:51:44.026912 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 11:51:44.026912 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9j7GOxeGIIFRaUagx3tJg7kzBPQS2cxk3og2aVLgimTTH1090SH_5giPwfyU1y73oyU5R7SG-K5V1_b1YgmmYZ8EbLJylmuSH5aS-x4czAakx361z-Dp2ss8LUF4p4w3rd7ZOLjjDRcM0d68v7qBr1ObursQKyUF-HGRdXYLt3TZLEg Aug 12 11:51:44.026912 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 11:51:44.026912 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 11:51:44.026912 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 11:51:44.026912 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 11:51:44.026912 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 11:51:44.026912 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 11:51:44.026912 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: e5a7f5c2f3e34684bd5b8161ba77014c Aug 12 11:51:44.026912 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-474592928 Aug 12 11:51:44.026912 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 11:51:44.026912 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 11:51:44.028308 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e5a7f5c2f3e34684bd5b8161ba77014c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e5a7f5c2f3e34684bd5b8161ba77014c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5a7f5c2f3e34684bd5b8161ba77014c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5a7f5c2f3e34684bd5b8161ba77014c"}]}] Aug 12 11:51:44.028308 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-VolumesSnapshotsTestJSON-474592928 Aug 12 11:51:44.028308 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: e5a7f5c2f3e34684bd5b8161ba77014c Aug 12 11:51:44.028308 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-474592928 Aug 12 11:51:44.028308 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-VolumesSnapshotsTestJSON-474592928-project Aug 12 11:51:44.028308 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 11:51:44.028308 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 11:51:44.028308 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: 327a8f72755c4645a854d86d881de107 Aug 12 11:51:44.028308 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-VolumesSnapshotsTestJSON-474592928-project Aug 12 11:51:44.028308 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: Aug 12 11:51:44.028308 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Volume 3c82d0eb-4697-4644-939f-c06bfd88fe3f could not be found. Aug 12 11:51:44.028308 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'id': '3c82d0eb-4697-4644-939f-c06bfd88fe3f'} Aug 12 11:51:44.028308 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:51:44.029097 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:44.029097 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 11:51:44.029097 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 11:51:44.029097 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 11:51:44.029097 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 11:51:44.029097 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 11:51:44.029097 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 11:51:44.029097 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 11:51:44.029097 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 11:51:44.029097 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 11:51:44.029097 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 11:51:44.029097 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 11:51:44.029097 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 11:51:44.029097 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 11:51:44.029097 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 11:51:44.029097 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3c82d0eb-4697-4644-939f-c06bfd88fe3f could not be found. (HTTP 404) (Request-ID: req-a2ef76c6-8979-4a55-b7e7-9f8c5657d891) Aug 12 11:51:44.029097 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:44.029097 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:51:44.029097 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:44.030110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:44.030110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 12 11:51:44.030110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 12 11:51:44.030110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 11:51:44.030110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 11:51:44.030110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 11:51:44.030110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 11:51:44.030110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 11:51:44.030110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 11:51:44.030110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 11:51:44.030110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 11:51:44.030110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 11:51:44.030110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 11:51:44.030110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 11:51:44.030110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 11:51:44.030110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 11:51:44.030110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 11:51:44.030110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 11:51:44.030110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 11:51:44.031127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 11:51:44.031127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 11:51:44.031127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 11:51:44.031127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 11:51:44.031127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3c82d0eb-4697-4644-939f-c06bfd88fe3f could not be found. Aug 12 11:51:44.031127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:44.031127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:51:44.031127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:44.031127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:44.031127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:51:44.031127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:51:44.031127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:51:44.031127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:51:44.031127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 11:51:44.031127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 11:51:44.031127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:51:44.031127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:51:44.031127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 12 11:51:44.031127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:51:44.033008 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3c82d0eb-4697-4644-939f-c06bfd88fe3f could not be found. Aug 12 11:51:44.033008 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:44.033008 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:51:44.033008 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:44.033008 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:51:44.033008 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:51:44.033008 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:51:44.033008 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:51:44.033008 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:51:44.033008 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3c82d0eb-4697-4644-939f-c06bfd88fe3f could not be found. Aug 12 11:51:44.033008 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:51:44.033008 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-2cb9b364-395e-4b12-a309-86230a5e39f0 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] Returning 404 to user: Volume 3c82d0eb-4697-4644-939f-c06bfd88fe3f could not be found. {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:51:44.033008 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-2cb9b364-395e-4b12-a309-86230a5e39f0 tempest-VolumesSnapshotsTestJSON-474592928 tempest-VolumesSnapshotsTestJSON-474592928-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3c82d0eb-4697-4644-939f-c06bfd88fe3f" status: 404 len: 109 microversion: 2.1 time: 0.038749 Aug 12 11:51:44.033008 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 158/314] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Aug 12 11:51:43 2022] GET /compute/v2.1/os-volumes/3c82d0eb-4697-4644-939f-c06bfd88fe3f => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:51:44.614080 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-af8c61d7-b899-491a-936a-2a7c9732dd68 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:44.614728 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-af8c61d7-b899-491a-936a-2a7c9732dd68 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:44.622138 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-af8c61d7-b899-491a-936a-2a7c9732dd68 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:44.622923 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-af8c61d7-b899-491a-936a-2a7c9732dd68 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:44.623714 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-af8c61d7-b899-491a-936a-2a7c9732dd68 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:44.624761 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-af8c61d7-b899-491a-936a-2a7c9732dd68 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:44.625426 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-af8c61d7-b899-491a-936a-2a7c9732dd68 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:44.625859 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-af8c61d7-b899-491a-936a-2a7c9732dd68 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:44.888677 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-af8c61d7-b899-491a-936a-2a7c9732dd68 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:44.897789 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-af8c61d7-b899-491a-936a-2a7c9732dd68 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.289128 Aug 12 11:51:44.898616 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 157/315] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:44 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:45.927081 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-84b9b220-de1e-4367-b7ea-6ea1277a8d91 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:45.927869 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-84b9b220-de1e-4367-b7ea-6ea1277a8d91 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:45.931899 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:45.946919 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-84b9b220-de1e-4367-b7ea-6ea1277a8d91 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:45.947505 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-84b9b220-de1e-4367-b7ea-6ea1277a8d91 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:45.948462 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-84b9b220-de1e-4367-b7ea-6ea1277a8d91 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:45.951721 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-84b9b220-de1e-4367-b7ea-6ea1277a8d91 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:45.952554 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-84b9b220-de1e-4367-b7ea-6ea1277a8d91 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:45.953045 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-84b9b220-de1e-4367-b7ea-6ea1277a8d91 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:46.239584 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-84b9b220-de1e-4367-b7ea-6ea1277a8d91 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:46.253758 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-84b9b220-de1e-4367-b7ea-6ea1277a8d91 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.336565 Aug 12 11:51:46.254632 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 159/316] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:45 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:47.278300 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-fd844b1a-f29d-445e-b2ef-aaf364749383 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:47.280159 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-fd844b1a-f29d-445e-b2ef-aaf364749383 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:47.289840 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fd844b1a-f29d-445e-b2ef-aaf364749383 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:47.290550 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fd844b1a-f29d-445e-b2ef-aaf364749383 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:47.291219 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fd844b1a-f29d-445e-b2ef-aaf364749383 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:47.292102 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fd844b1a-f29d-445e-b2ef-aaf364749383 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:47.293248 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fd844b1a-f29d-445e-b2ef-aaf364749383 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:47.293828 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fd844b1a-f29d-445e-b2ef-aaf364749383 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:47.593378 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-fd844b1a-f29d-445e-b2ef-aaf364749383 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:47.608332 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-fd844b1a-f29d-445e-b2ef-aaf364749383 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.333225 Aug 12 11:51:47.610438 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 158/317] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:47 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:48.633649 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-3f0c1fba-d050-4aba-8afd-4fbb7c246c01 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:48.634475 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-3f0c1fba-d050-4aba-8afd-4fbb7c246c01 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:48.647625 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3f0c1fba-d050-4aba-8afd-4fbb7c246c01 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:48.648208 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3f0c1fba-d050-4aba-8afd-4fbb7c246c01 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:48.648738 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3f0c1fba-d050-4aba-8afd-4fbb7c246c01 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:48.651472 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3f0c1fba-d050-4aba-8afd-4fbb7c246c01 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:48.658706 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3f0c1fba-d050-4aba-8afd-4fbb7c246c01 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:48.666269 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3f0c1fba-d050-4aba-8afd-4fbb7c246c01 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:48.933912 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-3f0c1fba-d050-4aba-8afd-4fbb7c246c01 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:48.946926 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-3f0c1fba-d050-4aba-8afd-4fbb7c246c01 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.316998 Aug 12 11:51:48.959473 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 160/318] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:48 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:49.969633 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d33731c2-97e0-41f1-861f-448b09b24a37 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:49.970723 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d33731c2-97e0-41f1-861f-448b09b24a37 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:49.978151 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d33731c2-97e0-41f1-861f-448b09b24a37 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:49.979688 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d33731c2-97e0-41f1-861f-448b09b24a37 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:49.980177 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d33731c2-97e0-41f1-861f-448b09b24a37 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:49.983052 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d33731c2-97e0-41f1-861f-448b09b24a37 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:49.983518 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d33731c2-97e0-41f1-861f-448b09b24a37 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:49.983951 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d33731c2-97e0-41f1-861f-448b09b24a37 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:50.148018 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d33731c2-97e0-41f1-861f-448b09b24a37 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:50.160040 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-d33731c2-97e0-41f1-861f-448b09b24a37 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.190039 Aug 12 11:51:50.160649 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 159/319] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:49 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:51.181351 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-a263784e-4e3e-4076-95e9-77dbd22df3f3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:51.183330 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-a263784e-4e3e-4076-95e9-77dbd22df3f3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:51.194925 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a263784e-4e3e-4076-95e9-77dbd22df3f3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:51.196743 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a263784e-4e3e-4076-95e9-77dbd22df3f3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:51.198067 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a263784e-4e3e-4076-95e9-77dbd22df3f3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:51.200193 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a263784e-4e3e-4076-95e9-77dbd22df3f3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:51.200850 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a263784e-4e3e-4076-95e9-77dbd22df3f3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:51.203433 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a263784e-4e3e-4076-95e9-77dbd22df3f3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:51.455106 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-a263784e-4e3e-4076-95e9-77dbd22df3f3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:51.464271 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-a263784e-4e3e-4076-95e9-77dbd22df3f3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.286739 Aug 12 11:51:51.478316 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 161/320] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:51 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:52.485260 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e905511f-f612-4c22-8208-246697adb6f8 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:52.486528 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-e905511f-f612-4c22-8208-246697adb6f8 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:52.496427 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e905511f-f612-4c22-8208-246697adb6f8 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:52.496977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e905511f-f612-4c22-8208-246697adb6f8 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:52.497469 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e905511f-f612-4c22-8208-246697adb6f8 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:52.498361 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e905511f-f612-4c22-8208-246697adb6f8 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:52.499177 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e905511f-f612-4c22-8208-246697adb6f8 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:52.499612 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e905511f-f612-4c22-8208-246697adb6f8 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:52.762680 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e905511f-f612-4c22-8208-246697adb6f8 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:52.772713 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e905511f-f612-4c22-8208-246697adb6f8 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1521 microversion: 2.1 time: 0.291131 Aug 12 11:51:52.786342 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 160/321] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:52 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:53.005127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-c4d223ba-8877-4e3a-8d4e-eb53bf15d560 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:53.006388 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-c4d223ba-8877-4e3a-8d4e-eb53bf15d560 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:53.019528 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c4d223ba-8877-4e3a-8d4e-eb53bf15d560 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:53.020013 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c4d223ba-8877-4e3a-8d4e-eb53bf15d560 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:53.020439 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c4d223ba-8877-4e3a-8d4e-eb53bf15d560 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:53.021748 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c4d223ba-8877-4e3a-8d4e-eb53bf15d560 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:53.022738 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c4d223ba-8877-4e3a-8d4e-eb53bf15d560 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:53.023396 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c4d223ba-8877-4e3a-8d4e-eb53bf15d560 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:53.073056 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-c4d223ba-8877-4e3a-8d4e-eb53bf15d560 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65/ips" status: 200 len: 151 microversion: 2.1 time: 0.074889 Aug 12 11:51:53.075418 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 162/322] 10.222.0.42 () {58 vars in 1248 bytes} [Fri Aug 12 11:51:52 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65/ips => generated 151 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:51:53.809984 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-c8df0b47-183a-47ec-bc03-c20676c1885c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:53.813087 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-c8df0b47-183a-47ec-bc03-c20676c1885c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:53.819577 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c8df0b47-183a-47ec-bc03-c20676c1885c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:53.820399 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c8df0b47-183a-47ec-bc03-c20676c1885c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:53.821050 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c8df0b47-183a-47ec-bc03-c20676c1885c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:53.821996 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c8df0b47-183a-47ec-bc03-c20676c1885c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:53.822673 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c8df0b47-183a-47ec-bc03-c20676c1885c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:53.823322 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c8df0b47-183a-47ec-bc03-c20676c1885c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:53.981844 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-c8df0b47-183a-47ec-bc03-c20676c1885c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:53.990791 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-c8df0b47-183a-47ec-bc03-c20676c1885c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1501 microversion: 2.1 time: 0.187500 Aug 12 11:51:53.992222 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 161/323] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:53 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1501 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:54.013216 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-68af7a67-df99-4592-b9db-125b41172f5c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:54.014355 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-68af7a67-df99-4592-b9db-125b41172f5c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:54.021203 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-68af7a67-df99-4592-b9db-125b41172f5c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:54.021685 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-68af7a67-df99-4592-b9db-125b41172f5c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:54.022445 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-68af7a67-df99-4592-b9db-125b41172f5c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:54.023551 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-68af7a67-df99-4592-b9db-125b41172f5c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:54.024072 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-68af7a67-df99-4592-b9db-125b41172f5c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:54.025057 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-68af7a67-df99-4592-b9db-125b41172f5c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:54.381059 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-68af7a67-df99-4592-b9db-125b41172f5c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:54.390798 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-68af7a67-df99-4592-b9db-125b41172f5c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1516 microversion: 2.1 time: 0.381991 Aug 12 11:51:54.402844 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 163/324] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:54 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1516 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:54.693330 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-9dc4fadf-d7ad-4f06-9b3a-fa32a9d57096 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4da5e068-1358-4aa4-b164-f93909d60a78"}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:51:54.696379 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-9dc4fadf-d7ad-4f06-9b3a-fa32a9d57096 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:54.712885 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9dc4fadf-d7ad-4f06-9b3a-fa32a9d57096 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:54.713939 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9dc4fadf-d7ad-4f06-9b3a-fa32a9d57096 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:54.718883 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9dc4fadf-d7ad-4f06-9b3a-fa32a9d57096 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:54.721918 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9dc4fadf-d7ad-4f06-9b3a-fa32a9d57096 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:54.722514 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9dc4fadf-d7ad-4f06-9b3a-fa32a9d57096 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:54.724132 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9dc4fadf-d7ad-4f06-9b3a-fa32a9d57096 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:55.418245 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-9dc4fadf-d7ad-4f06-9b3a-fa32a9d57096 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "POST /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.730065 Aug 12 11:51:55.422824 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 162/325] 10.222.0.42 () {60 vars in 1323 bytes} [Fri Aug 12 11:51:54 2022] POST /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65/os-volume_attachments => generated 194 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:51:56.241705 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-1ceedb0f-45da-4f76-a7d8-d5ccb1b0bd4f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:51:56.244799 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-1ceedb0f-45da-4f76-a7d8-d5ccb1b0bd4f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:56.261831 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1ceedb0f-45da-4f76-a7d8-d5ccb1b0bd4f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:56.262860 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1ceedb0f-45da-4f76-a7d8-d5ccb1b0bd4f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:56.267003 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1ceedb0f-45da-4f76-a7d8-d5ccb1b0bd4f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:56.268055 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1ceedb0f-45da-4f76-a7d8-d5ccb1b0bd4f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:56.269646 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1ceedb0f-45da-4f76-a7d8-d5ccb1b0bd4f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:56.270510 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1ceedb0f-45da-4f76-a7d8-d5ccb1b0bd4f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:56.318198 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.objects.instance [None req-1ceedb0f-45da-4f76-a7d8-d5ccb1b0bd4f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lazy-loading 'flavor' on Instance uuid 5109a18a-e7ab-4ce9-904b-63c1dfc7197a {{(pid=132281) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:51:56.445007 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-1ceedb0f-45da-4f76-a7d8-d5ccb1b0bd4f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "POST /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a/action" status: 200 len: 32 microversion: 2.1 time: 0.206760 Aug 12 11:51:56.451703 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 164/326] 10.222.0.42 () {60 vars in 1278 bytes} [Fri Aug 12 11:51:56 2022] POST /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a/action => generated 32 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 11:51:56.457962 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-10326833-4a6c-473c-8c22-ccc8835416b4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:56.458702 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-10326833-4a6c-473c-8c22-ccc8835416b4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:56.468975 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-10326833-4a6c-473c-8c22-ccc8835416b4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:56.473737 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-10326833-4a6c-473c-8c22-ccc8835416b4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:56.474899 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-10326833-4a6c-473c-8c22-ccc8835416b4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:56.476023 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-10326833-4a6c-473c-8c22-ccc8835416b4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:56.476813 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-10326833-4a6c-473c-8c22-ccc8835416b4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:56.477578 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-10326833-4a6c-473c-8c22-ccc8835416b4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:57.060794 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-10326833-4a6c-473c-8c22-ccc8835416b4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:57.072723 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-10326833-4a6c-473c-8c22-ccc8835416b4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1522 microversion: 2.1 time: 0.617934 Aug 12 11:51:57.073335 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 163/327] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:56 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1522 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:51:58.098242 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-76c526aa-2313-4dbf-935d-e592eafce31f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:58.099089 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-76c526aa-2313-4dbf-935d-e592eafce31f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:58.110077 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-76c526aa-2313-4dbf-935d-e592eafce31f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:58.113842 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-76c526aa-2313-4dbf-935d-e592eafce31f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:58.114536 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-76c526aa-2313-4dbf-935d-e592eafce31f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:58.115500 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-76c526aa-2313-4dbf-935d-e592eafce31f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:58.117135 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-76c526aa-2313-4dbf-935d-e592eafce31f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:58.118029 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-76c526aa-2313-4dbf-935d-e592eafce31f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:58.407300 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-76c526aa-2313-4dbf-935d-e592eafce31f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:58.420454 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-76c526aa-2313-4dbf-935d-e592eafce31f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1522 microversion: 2.1 time: 0.327389 Aug 12 11:51:58.421366 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 165/328] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:58 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:59.447383 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-8f7d5a1a-dd2f-4b8b-93c9-793ccc9d4715 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:59.448011 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-8f7d5a1a-dd2f-4b8b-93c9-793ccc9d4715 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:59.459734 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8f7d5a1a-dd2f-4b8b-93c9-793ccc9d4715 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:59.460506 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8f7d5a1a-dd2f-4b8b-93c9-793ccc9d4715 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:59.461128 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8f7d5a1a-dd2f-4b8b-93c9-793ccc9d4715 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:59.463055 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8f7d5a1a-dd2f-4b8b-93c9-793ccc9d4715 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:59.463520 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8f7d5a1a-dd2f-4b8b-93c9-793ccc9d4715 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:59.463959 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8f7d5a1a-dd2f-4b8b-93c9-793ccc9d4715 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:59.659069 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-8f7d5a1a-dd2f-4b8b-93c9-793ccc9d4715 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:51:59.671385 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-8f7d5a1a-dd2f-4b8b-93c9-793ccc9d4715 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1522 microversion: 2.1 time: 0.231465 Aug 12 11:51:59.671962 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 164/329] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:51:59 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:51:59.870331 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-ef848550-fcfe-4f5b-aa82-be90ac883bda tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:51:59.871469 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-ef848550-fcfe-4f5b-aa82-be90ac883bda tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:51:59.886917 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ef848550-fcfe-4f5b-aa82-be90ac883bda tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:59.887580 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ef848550-fcfe-4f5b-aa82-be90ac883bda tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:59.888145 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ef848550-fcfe-4f5b-aa82-be90ac883bda tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:59.889500 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ef848550-fcfe-4f5b-aa82-be90ac883bda tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:51:59.896569 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ef848550-fcfe-4f5b-aa82-be90ac883bda tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:51:59.897246 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ef848550-fcfe-4f5b-aa82-be90ac883bda tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:51:59.935317 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-ef848550-fcfe-4f5b-aa82-be90ac883bda tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db/ips" status: 200 len: 147 microversion: 2.1 time: 0.071913 Aug 12 11:51:59.941057 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 166/330] 10.222.0.42 () {58 vars in 1248 bytes} [Fri Aug 12 11:51:59 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db/ips => generated 147 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:52:00.528677 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-efa8f68b-2668-45e4-ae48-6f4065c0f060 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:00.530383 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-efa8f68b-2668-45e4-ae48-6f4065c0f060 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:00.540644 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-efa8f68b-2668-45e4-ae48-6f4065c0f060 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:00.541532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-efa8f68b-2668-45e4-ae48-6f4065c0f060 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:00.542168 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-efa8f68b-2668-45e4-ae48-6f4065c0f060 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:00.543441 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-efa8f68b-2668-45e4-ae48-6f4065c0f060 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:00.544112 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-efa8f68b-2668-45e4-ae48-6f4065c0f060 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:00.544734 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-efa8f68b-2668-45e4-ae48-6f4065c0f060 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:00.572904 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-efa8f68b-2668-45e4-ae48-6f4065c0f060 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531/ips" status: 200 len: 152 microversion: 2.20 time: 0.048465 Aug 12 11:52:00.575577 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 165/331] 10.222.0.42 () {60 vars in 1289 bytes} [Fri Aug 12 11:52:00 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531/ips => generated 152 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 11:52:00.693373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-f276ce0c-e93f-4d99-8112-75c30942ac15 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:00.693981 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-f276ce0c-e93f-4d99-8112-75c30942ac15 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:00.700628 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f276ce0c-e93f-4d99-8112-75c30942ac15 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:00.702944 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f276ce0c-e93f-4d99-8112-75c30942ac15 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:00.703640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f276ce0c-e93f-4d99-8112-75c30942ac15 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:00.706059 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f276ce0c-e93f-4d99-8112-75c30942ac15 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:00.706548 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f276ce0c-e93f-4d99-8112-75c30942ac15 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:00.707006 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f276ce0c-e93f-4d99-8112-75c30942ac15 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:01.015024 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-f276ce0c-e93f-4d99-8112-75c30942ac15 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:01.025567 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-f276ce0c-e93f-4d99-8112-75c30942ac15 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1522 microversion: 2.1 time: 0.336061 Aug 12 11:52:01.026708 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 167/332] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:00 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:02.067364 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-7cb3eee1-77af-48f8-a1cc-75ed231512cb tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:02.068667 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-7cb3eee1-77af-48f8-a1cc-75ed231512cb tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:02.076858 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7cb3eee1-77af-48f8-a1cc-75ed231512cb tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:02.077592 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7cb3eee1-77af-48f8-a1cc-75ed231512cb tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:02.078424 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7cb3eee1-77af-48f8-a1cc-75ed231512cb tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:02.079363 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7cb3eee1-77af-48f8-a1cc-75ed231512cb tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:02.080132 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7cb3eee1-77af-48f8-a1cc-75ed231512cb tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:02.080898 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7cb3eee1-77af-48f8-a1cc-75ed231512cb tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:02.250367 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-7cb3eee1-77af-48f8-a1cc-75ed231512cb tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:02.258676 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-7cb3eee1-77af-48f8-a1cc-75ed231512cb tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1522 microversion: 2.1 time: 0.195604 Aug 12 11:52:02.260883 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 166/333] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:02 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:02.716540 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-7b60e4a7-ec40-470d-a0e6-ffbb1eda759d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06f187bc-b87b-4731-b3c8-76197e816cdc"}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:52:02.717660 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-b0c5cd13-a529-4b14-a9b0-1d43cb7a7da5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:52:02.720810 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-b0c5cd13-a529-4b14-a9b0-1d43cb7a7da5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:02.730977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-7b60e4a7-ec40-470d-a0e6-ffbb1eda759d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:02.744510 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7b60e4a7-ec40-470d-a0e6-ffbb1eda759d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:02.745592 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7b60e4a7-ec40-470d-a0e6-ffbb1eda759d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:02.746129 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7b60e4a7-ec40-470d-a0e6-ffbb1eda759d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:02.747200 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7b60e4a7-ec40-470d-a0e6-ffbb1eda759d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:02.748006 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7b60e4a7-ec40-470d-a0e6-ffbb1eda759d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:02.748824 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7b60e4a7-ec40-470d-a0e6-ffbb1eda759d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:02.752175 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b0c5cd13-a529-4b14-a9b0-1d43cb7a7da5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:02.752701 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b0c5cd13-a529-4b14-a9b0-1d43cb7a7da5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:02.753475 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b0c5cd13-a529-4b14-a9b0-1d43cb7a7da5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:02.755748 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b0c5cd13-a529-4b14-a9b0-1d43cb7a7da5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:02.756214 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b0c5cd13-a529-4b14-a9b0-1d43cb7a7da5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:02.756972 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b0c5cd13-a529-4b14-a9b0-1d43cb7a7da5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:02.824943 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.objects.instance [None req-b0c5cd13-a529-4b14-a9b0-1d43cb7a7da5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lazy-loading 'flavor' on Instance uuid 712bb3a1-789a-442f-8d59-a635f0896531 {{(pid=132281) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:52:03.121193 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-b0c5cd13-a529-4b14-a9b0-1d43cb7a7da5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "POST /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531/action" status: 202 len: 0 microversion: 2.20 time: 0.414523 Aug 12 11:52:03.123890 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 168/334] 10.222.0.42 () {62 vars in 1319 bytes} [Fri Aug 12 11:52:02 2022] POST /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 12 11:52:03.150278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-d62d2cf6-946e-4f8c-85f6-a036d98fac5b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:03.158799 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-d62d2cf6-946e-4f8c-85f6-a036d98fac5b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:03.175420 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d62d2cf6-946e-4f8c-85f6-a036d98fac5b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:03.176473 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d62d2cf6-946e-4f8c-85f6-a036d98fac5b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:03.177147 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d62d2cf6-946e-4f8c-85f6-a036d98fac5b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:03.178433 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d62d2cf6-946e-4f8c-85f6-a036d98fac5b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:03.179128 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d62d2cf6-946e-4f8c-85f6-a036d98fac5b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:03.179840 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d62d2cf6-946e-4f8c-85f6-a036d98fac5b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:03.244174 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-7b60e4a7-ec40-470d-a0e6-ffbb1eda759d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "POST /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.532455 Aug 12 11:52:03.246896 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 167/335] 10.222.0.42 () {60 vars in 1323 bytes} [Fri Aug 12 11:52:02 2022] POST /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db/os-volume_attachments => generated 194 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:52:03.291413 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-65a12922-7fd4-4f8e-a064-8a4ccaf5e539 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:03.293064 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-65a12922-7fd4-4f8e-a064-8a4ccaf5e539 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:03.309945 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-65a12922-7fd4-4f8e-a064-8a4ccaf5e539 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:03.312195 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-65a12922-7fd4-4f8e-a064-8a4ccaf5e539 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:03.327448 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-65a12922-7fd4-4f8e-a064-8a4ccaf5e539 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:03.332597 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-65a12922-7fd4-4f8e-a064-8a4ccaf5e539 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:03.334753 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-65a12922-7fd4-4f8e-a064-8a4ccaf5e539 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:03.336382 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-65a12922-7fd4-4f8e-a064-8a4ccaf5e539 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:03.607247 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-d62d2cf6-946e-4f8c-85f6-a036d98fac5b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:03.657903 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-d62d2cf6-946e-4f8c-85f6-a036d98fac5b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:03.659582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-d62d2cf6-946e-4f8c-85f6-a036d98fac5b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:03.660659 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-d62d2cf6-946e-4f8c-85f6-a036d98fac5b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1724 microversion: 2.20 time: 0.518616 Aug 12 11:52:03.661229 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 169/336] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:03 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1724 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:03.668656 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-b9f58b48-5018-4e6c-96df-524ecc22127e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Action: 'create', calling method: .version_select at 0x7f3e585df310>, body: {"keypair": {"name": "tempest-keypair-1488307215", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqBiUpjv96YB7ahJRQFXM3A3RCQjWLcDYh5cZATtmcLnu/7EhyGIDUpjf6Xe5KnzhcroAE3SevRcvDH/Yrvm40mf1KC/4tf3idIK1c2GGHGyyECF97dZA0K0ceI1DMI5g=="}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:52:03.705944 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-65a12922-7fd4-4f8e-a064-8a4ccaf5e539 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:03.707110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.quota [None req-b9f58b48-5018-4e6c-96df-524ecc22127e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Getting quotas for project 8299891a8d134af4be3f84cdc7abec51. Resources: {'key_pairs'} {{(pid=132281) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:52:03.712108 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.quota [None req-b9f58b48-5018-4e6c-96df-524ecc22127e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Getting quotas for user 72a30400dec14a85889af8d8dd59886e and project 8299891a8d134af4be3f84cdc7abec51. Resources: {'key_pairs'} {{(pid=132281) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:52:03.715159 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-65a12922-7fd4-4f8e-a064-8a4ccaf5e539 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1522 microversion: 2.1 time: 0.430429 Aug 12 11:52:03.737550 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 168/337] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:03 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1522 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:52:03.754773 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-b9f58b48-5018-4e6c-96df-524ecc22127e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.091656 Aug 12 11:52:03.758785 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 170/338] 10.222.0.42 () {60 vars in 1159 bytes} [Fri Aug 12 11:52:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:52:04.686451 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-ed70e95c-7eb9-4d68-8ed5-191bb1bb7de9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:04.687114 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-ed70e95c-7eb9-4d68-8ed5-191bb1bb7de9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:04.696108 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ed70e95c-7eb9-4d68-8ed5-191bb1bb7de9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:04.696606 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ed70e95c-7eb9-4d68-8ed5-191bb1bb7de9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:04.697052 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ed70e95c-7eb9-4d68-8ed5-191bb1bb7de9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:04.698221 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ed70e95c-7eb9-4d68-8ed5-191bb1bb7de9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:04.705574 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ed70e95c-7eb9-4d68-8ed5-191bb1bb7de9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:04.706310 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ed70e95c-7eb9-4d68-8ed5-191bb1bb7de9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:04.746238 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e53de4d3-64a8-43b7-8fc2-89bc4e302703 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:04.747151 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-e53de4d3-64a8-43b7-8fc2-89bc4e302703 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:04.760105 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e53de4d3-64a8-43b7-8fc2-89bc4e302703 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:04.760720 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e53de4d3-64a8-43b7-8fc2-89bc4e302703 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:04.761040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e53de4d3-64a8-43b7-8fc2-89bc4e302703 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:04.765112 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e53de4d3-64a8-43b7-8fc2-89bc4e302703 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:04.765506 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e53de4d3-64a8-43b7-8fc2-89bc4e302703 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:04.768225 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e53de4d3-64a8-43b7-8fc2-89bc4e302703 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:05.269476 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-ed70e95c-7eb9-4d68-8ed5-191bb1bb7de9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:05.276975 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:05.280981 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-e53de4d3-64a8-43b7-8fc2-89bc4e302703 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:05.289112 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-e53de4d3-64a8-43b7-8fc2-89bc4e302703 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1522 microversion: 2.1 time: 0.548307 Aug 12 11:52:05.307184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-ed70e95c-7eb9-4d68-8ed5-191bb1bb7de9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:05.307184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-ed70e95c-7eb9-4d68-8ed5-191bb1bb7de9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:05.307739 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 171/339] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:04 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1522 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:52:05.313582 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-ed70e95c-7eb9-4d68-8ed5-191bb1bb7de9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1724 microversion: 2.20 time: 0.629092 Aug 12 11:52:05.315154 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 169/340] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:04 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1724 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:06.115696 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-2bc6bba3-2e98-4717-b505-f3f3ad3539ac tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1882531877", "imageRef": "2887ca5b-6aa2-4cc4-a2be-9322a733fc6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7833e310-6d60-47b5-8e0a-4784db7aa59d"}], "security_groups": [{"name": "tempest-securitygroup--591163968"}], "key_name": "tempest-keypair-1488307215", "user_data": "}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:52:06.266571 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.network.neutron [None req-2bc6bba3-2e98-4717-b505-f3f3ad3539ac tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] validate_networks() for [('7833e310-6d60-47b5-8e0a-4784db7aa59d', None, None, None, None, None)] {{(pid=132281) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 11:52:06.315631 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d1fdc332-42fb-4b0c-96d4-14758ce8a73c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:06.316399 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d1fdc332-42fb-4b0c-96d4-14758ce8a73c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:06.338247 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d1fdc332-42fb-4b0c-96d4-14758ce8a73c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:06.338815 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d1fdc332-42fb-4b0c-96d4-14758ce8a73c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:06.343823 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d1fdc332-42fb-4b0c-96d4-14758ce8a73c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:06.344683 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d1fdc332-42fb-4b0c-96d4-14758ce8a73c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:06.345171 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d1fdc332-42fb-4b0c-96d4-14758ce8a73c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:06.345612 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d1fdc332-42fb-4b0c-96d4-14758ce8a73c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:06.571937 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d1fdc332-42fb-4b0c-96d4-14758ce8a73c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:06.588585 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-d1fdc332-42fb-4b0c-96d4-14758ce8a73c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1522 microversion: 2.1 time: 0.277917 Aug 12 11:52:06.590204 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 170/341] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:06 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:06.607989 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-6bf2e5d6-72fc-4303-934d-db030d24f829 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:06.608892 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-6bf2e5d6-72fc-4303-934d-db030d24f829 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:06.622183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6bf2e5d6-72fc-4303-934d-db030d24f829 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:06.624312 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6bf2e5d6-72fc-4303-934d-db030d24f829 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:06.624772 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6bf2e5d6-72fc-4303-934d-db030d24f829 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:06.625489 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6bf2e5d6-72fc-4303-934d-db030d24f829 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:06.625948 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6bf2e5d6-72fc-4303-934d-db030d24f829 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:06.626388 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6bf2e5d6-72fc-4303-934d-db030d24f829 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:06.917971 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-6bf2e5d6-72fc-4303-934d-db030d24f829 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:06.935432 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-6bf2e5d6-72fc-4303-934d-db030d24f829 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:06.936929 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-6bf2e5d6-72fc-4303-934d-db030d24f829 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:06.938122 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-6bf2e5d6-72fc-4303-934d-db030d24f829 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1724 microversion: 2.20 time: 0.346566 Aug 12 11:52:06.942674 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 171/342] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:06 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1724 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:06.967922 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-2bc6bba3-2e98-4717-b505-f3f3ad3539ac tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Flavor limits 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 11:52:06.968343 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-2bc6bba3-2e98-4717-b505-f3f3ad3539ac tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Image limits 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 11:52:06.968823 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-2bc6bba3-2e98-4717-b505-f3f3ad3539ac tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Flavor pref 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 11:52:06.969212 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-2bc6bba3-2e98-4717-b505-f3f3ad3539ac tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Image pref 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 11:52:06.969643 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-2bc6bba3-2e98-4717-b505-f3f3ad3539ac tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 11:52:06.980276 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2bc6bba3-2e98-4717-b505-f3f3ad3539ac tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:06.980760 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2bc6bba3-2e98-4717-b505-f3f3ad3539ac tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:06.981194 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2bc6bba3-2e98-4717-b505-f3f3ad3539ac tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:06.982065 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2bc6bba3-2e98-4717-b505-f3f3ad3539ac tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:06.982744 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2bc6bba3-2e98-4717-b505-f3f3ad3539ac tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:06.983348 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2bc6bba3-2e98-4717-b505-f3f3ad3539ac tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:07.006709 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.quota [None req-2bc6bba3-2e98-4717-b505-f3f3ad3539ac tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Getting quotas for project 8299891a8d134af4be3f84cdc7abec51. Resources: {'instances', 'ram', 'cores'} {{(pid=132281) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:52:07.012428 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.quota [None req-2bc6bba3-2e98-4717-b505-f3f3ad3539ac tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Getting quotas for user 72a30400dec14a85889af8d8dd59886e and project 8299891a8d134af4be3f84cdc7abec51. Resources: {'instances', 'ram', 'cores'} {{(pid=132281) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:52:07.027884 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-2bc6bba3-2e98-4717-b505-f3f3ad3539ac tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Going to run 1 instances... {{(pid=132281) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 11:52:07.030484 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-2bc6bba3-2e98-4717-b505-f3f3ad3539ac tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2887ca5b-6aa2-4cc4-a2be-9322a733fc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132281) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 11:52:07.096861 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-2bc6bba3-2e98-4717-b505-f3f3ad3539ac tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.986463 Aug 12 11:52:07.097657 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 172/343] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Aug 12 11:52:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 11:52:07.112516 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-fe314cfb-e75b-4489-a1f0-7c4093ee3a55 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:07.113122 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-fe314cfb-e75b-4489-a1f0-7c4093ee3a55 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:07.189796 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-fe314cfb-e75b-4489-a1f0-7c4093ee3a55 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:07.204974 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-fe314cfb-e75b-4489-a1f0-7c4093ee3a55 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f" status: 200 len: 1242 microversion: 2.1 time: 0.100232 Aug 12 11:52:07.223068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 172/344] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:07 2022] GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f => generated 1242 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:07.613430 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-50e22aa5-beba-405d-8c34-4383e0e3402a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:07.615119 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-50e22aa5-beba-405d-8c34-4383e0e3402a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:07.633111 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-50e22aa5-beba-405d-8c34-4383e0e3402a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:07.637645 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-50e22aa5-beba-405d-8c34-4383e0e3402a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:07.639929 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-50e22aa5-beba-405d-8c34-4383e0e3402a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:07.643661 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-50e22aa5-beba-405d-8c34-4383e0e3402a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:07.644140 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-50e22aa5-beba-405d-8c34-4383e0e3402a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:07.648854 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-50e22aa5-beba-405d-8c34-4383e0e3402a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:07.914770 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-50e22aa5-beba-405d-8c34-4383e0e3402a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:07.940042 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:07.944253 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-50e22aa5-beba-405d-8c34-4383e0e3402a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1522 microversion: 2.1 time: 0.336262 Aug 12 11:52:07.956111 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 173/345] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:07 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:07.965762 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-6d44a762-182a-43bc-b076-88a852580577 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:07.967110 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-6d44a762-182a-43bc-b076-88a852580577 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:07.976089 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6d44a762-182a-43bc-b076-88a852580577 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:07.976590 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6d44a762-182a-43bc-b076-88a852580577 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:07.977025 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6d44a762-182a-43bc-b076-88a852580577 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:07.977737 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6d44a762-182a-43bc-b076-88a852580577 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:07.978182 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6d44a762-182a-43bc-b076-88a852580577 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:07.978599 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6d44a762-182a-43bc-b076-88a852580577 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:08.183640 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-6d44a762-182a-43bc-b076-88a852580577 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:08.193208 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-6d44a762-182a-43bc-b076-88a852580577 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:08.195454 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-6d44a762-182a-43bc-b076-88a852580577 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:08.196905 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-6d44a762-182a-43bc-b076-88a852580577 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1724 microversion: 2.20 time: 0.239619 Aug 12 11:52:08.197832 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 173/346] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:07 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:08.227272 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e1dbcd17-b9e0-4ec3-a2a0-8413afec8df2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:08.228356 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-e1dbcd17-b9e0-4ec3-a2a0-8413afec8df2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:08.236607 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e1dbcd17-b9e0-4ec3-a2a0-8413afec8df2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:08.237704 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e1dbcd17-b9e0-4ec3-a2a0-8413afec8df2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:08.238511 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e1dbcd17-b9e0-4ec3-a2a0-8413afec8df2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:08.239800 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e1dbcd17-b9e0-4ec3-a2a0-8413afec8df2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:08.240364 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e1dbcd17-b9e0-4ec3-a2a0-8413afec8df2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:08.240889 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e1dbcd17-b9e0-4ec3-a2a0-8413afec8df2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:08.316119 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-e1dbcd17-b9e0-4ec3-a2a0-8413afec8df2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:08.324642 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-e1dbcd17-b9e0-4ec3-a2a0-8413afec8df2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f" status: 200 len: 1294 microversion: 2.1 time: 0.102961 Aug 12 11:52:08.325222 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 174/347] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:08 2022] GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f => generated 1294 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:52:08.968952 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-654e84f8-61c4-4f1d-bc1d-d81f67fefdd2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:08.970320 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-654e84f8-61c4-4f1d-bc1d-d81f67fefdd2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:08.983137 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-654e84f8-61c4-4f1d-bc1d-d81f67fefdd2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:08.984765 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-654e84f8-61c4-4f1d-bc1d-d81f67fefdd2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:08.986149 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-654e84f8-61c4-4f1d-bc1d-d81f67fefdd2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:08.987447 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-654e84f8-61c4-4f1d-bc1d-d81f67fefdd2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:08.991208 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-654e84f8-61c4-4f1d-bc1d-d81f67fefdd2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:08.992210 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-654e84f8-61c4-4f1d-bc1d-d81f67fefdd2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:09.221196 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-221e80ef-5269-427b-be20-97e49c05a59d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:09.221802 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-221e80ef-5269-427b-be20-97e49c05a59d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:09.231231 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-221e80ef-5269-427b-be20-97e49c05a59d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:09.231935 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-221e80ef-5269-427b-be20-97e49c05a59d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:09.232576 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-221e80ef-5269-427b-be20-97e49c05a59d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:09.233276 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-221e80ef-5269-427b-be20-97e49c05a59d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:09.234352 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-221e80ef-5269-427b-be20-97e49c05a59d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:09.234808 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-221e80ef-5269-427b-be20-97e49c05a59d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:09.247434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-654e84f8-61c4-4f1d-bc1d-d81f67fefdd2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:09.254967 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-654e84f8-61c4-4f1d-bc1d-d81f67fefdd2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1522 microversion: 2.1 time: 0.291476 Aug 12 11:52:09.255532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 174/348] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:08 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:09.347151 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-8f9b4969-5307-4ed7-999c-c0e5113107ad tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:09.348123 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-8f9b4969-5307-4ed7-999c-c0e5113107ad tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:09.359990 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8f9b4969-5307-4ed7-999c-c0e5113107ad tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:09.360487 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8f9b4969-5307-4ed7-999c-c0e5113107ad tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:09.361321 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8f9b4969-5307-4ed7-999c-c0e5113107ad tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:09.362035 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8f9b4969-5307-4ed7-999c-c0e5113107ad tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:09.362482 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8f9b4969-5307-4ed7-999c-c0e5113107ad tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:09.363669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8f9b4969-5307-4ed7-999c-c0e5113107ad tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:09.487123 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-8f9b4969-5307-4ed7-999c-c0e5113107ad tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:09.500790 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-8f9b4969-5307-4ed7-999c-c0e5113107ad tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f" status: 200 len: 1300 microversion: 2.1 time: 0.157766 Aug 12 11:52:09.516649 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 175/349] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:09 2022] GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f => generated 1300 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:52:09.523282 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-221e80ef-5269-427b-be20-97e49c05a59d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:09.534179 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-221e80ef-5269-427b-be20-97e49c05a59d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:09.535888 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-221e80ef-5269-427b-be20-97e49c05a59d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:09.537279 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-221e80ef-5269-427b-be20-97e49c05a59d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1724 microversion: 2.20 time: 0.319963 Aug 12 11:52:09.538291 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 175/350] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:09 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1724 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:52:10.277975 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-6db966f3-82dc-4c29-b3f8-2c565406690b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:10.279780 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-6db966f3-82dc-4c29-b3f8-2c565406690b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:10.299858 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_api:SELECT=48 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:10.304349 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6db966f3-82dc-4c29-b3f8-2c565406690b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:10.305845 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6db966f3-82dc-4c29-b3f8-2c565406690b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:10.309084 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6db966f3-82dc-4c29-b3f8-2c565406690b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:10.311217 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6db966f3-82dc-4c29-b3f8-2c565406690b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:10.313785 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6db966f3-82dc-4c29-b3f8-2c565406690b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:10.314391 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6db966f3-82dc-4c29-b3f8-2c565406690b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:10.534118 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-199c6f6d-c030-4bb9-9699-34a4208a4b47 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:10.537062 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-199c6f6d-c030-4bb9-9699-34a4208a4b47 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:10.551864 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-199c6f6d-c030-4bb9-9699-34a4208a4b47 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:10.556189 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-199c6f6d-c030-4bb9-9699-34a4208a4b47 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:10.557234 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-199c6f6d-c030-4bb9-9699-34a4208a4b47 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:10.558971 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-199c6f6d-c030-4bb9-9699-34a4208a4b47 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:10.559645 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-199c6f6d-c030-4bb9-9699-34a4208a4b47 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:10.560681 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-199c6f6d-c030-4bb9-9699-34a4208a4b47 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:10.814646 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-6db966f3-82dc-4c29-b3f8-2c565406690b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:10.837958 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-6db966f3-82dc-4c29-b3f8-2c565406690b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1522 microversion: 2.1 time: 0.558960 Aug 12 11:52:10.839719 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 176/351] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:10 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1522 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:10.844764 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-b9ecc8cc-ef6f-4129-aa6c-8f29841a1330 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:10.845544 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-b9ecc8cc-ef6f-4129-aa6c-8f29841a1330 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:10.857298 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b9ecc8cc-ef6f-4129-aa6c-8f29841a1330 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:10.859496 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b9ecc8cc-ef6f-4129-aa6c-8f29841a1330 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:10.862169 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b9ecc8cc-ef6f-4129-aa6c-8f29841a1330 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:10.863124 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b9ecc8cc-ef6f-4129-aa6c-8f29841a1330 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:10.863996 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b9ecc8cc-ef6f-4129-aa6c-8f29841a1330 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:10.865092 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b9ecc8cc-ef6f-4129-aa6c-8f29841a1330 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:11.020823 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-199c6f6d-c030-4bb9-9699-34a4208a4b47 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:11.043881 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-199c6f6d-c030-4bb9-9699-34a4208a4b47 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f" status: 200 len: 1367 microversion: 2.1 time: 0.523312 Aug 12 11:52:11.045942 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 176/352] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:10 2022] GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f => generated 1367 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:11.149920 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-857d9d0d-abd0-43fa-a680-291944adbf4c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:52:11.160631 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-857d9d0d-abd0-43fa-a680-291944adbf4c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:11.162977 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-857d9d0d-abd0-43fa-a680-291944adbf4c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:11.163899 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-857d9d0d-abd0-43fa-a680-291944adbf4c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:11.244463 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-b9ecc8cc-ef6f-4129-aa6c-8f29841a1330 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:11.256731 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-b9ecc8cc-ef6f-4129-aa6c-8f29841a1330 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:11.260332 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-b9ecc8cc-ef6f-4129-aa6c-8f29841a1330 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:11.265438 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-b9ecc8cc-ef6f-4129-aa6c-8f29841a1330 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1724 microversion: 2.20 time: 0.423138 Aug 12 11:52:11.267996 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-857d9d0d-abd0-43fa-a680-291944adbf4c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Going to try to stop instance {{(pid=132281) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 12 11:52:11.268144 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 177/353] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:10 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1724 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:11.331103 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-857d9d0d-abd0-43fa-a680-291944adbf4c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "POST /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db/action" status: 202 len: 0 microversion: 2.1 time: 0.185124 Aug 12 11:52:11.332070 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 177/354] 10.222.0.42 () {60 vars in 1278 bytes} [Fri Aug 12 11:52:11 2022] POST /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 12 11:52:11.342749 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-7cf154c9-1aaf-4124-90a5-2e12df5645ac tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:11.343947 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-7cf154c9-1aaf-4124-90a5-2e12df5645ac tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:11.355551 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7cf154c9-1aaf-4124-90a5-2e12df5645ac tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:11.356420 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7cf154c9-1aaf-4124-90a5-2e12df5645ac tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:11.357152 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7cf154c9-1aaf-4124-90a5-2e12df5645ac tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:11.358051 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7cf154c9-1aaf-4124-90a5-2e12df5645ac tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:11.358670 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7cf154c9-1aaf-4124-90a5-2e12df5645ac tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:11.359239 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7cf154c9-1aaf-4124-90a5-2e12df5645ac tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:11.668989 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-7cf154c9-1aaf-4124-90a5-2e12df5645ac tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:11.677993 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-7cf154c9-1aaf-4124-90a5-2e12df5645ac tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1725 microversion: 2.1 time: 0.341493 Aug 12 11:52:11.680228 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 178/355] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:11 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1725 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:11.853138 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-933ca495-44f4-4cc5-a460-2cb02e593715 req-8b59ba90-68a5-4b49-96e5-f2fb95f6ce93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f", "tag": "672dff2d-d9db-457b-b48d-9e22194e90c7"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:52:11.860747 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-22423d99-1cd4-4be3-bf72-88b442b9204d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:11.861445 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-22423d99-1cd4-4be3-bf72-88b442b9204d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:11.877226 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-22423d99-1cd4-4be3-bf72-88b442b9204d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:11.877718 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-22423d99-1cd4-4be3-bf72-88b442b9204d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:11.878461 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-22423d99-1cd4-4be3-bf72-88b442b9204d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:11.884643 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-933ca495-44f4-4cc5-a460-2cb02e593715 req-8b59ba90-68a5-4b49-96e5-f2fb95f6ce93 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:11.885130 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-933ca495-44f4-4cc5-a460-2cb02e593715 req-8b59ba90-68a5-4b49-96e5-f2fb95f6ce93 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:11.885554 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-933ca495-44f4-4cc5-a460-2cb02e593715 req-8b59ba90-68a5-4b49-96e5-f2fb95f6ce93 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:11.887988 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-22423d99-1cd4-4be3-bf72-88b442b9204d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:11.888556 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-22423d99-1cd4-4be3-bf72-88b442b9204d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:11.889002 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-22423d99-1cd4-4be3-bf72-88b442b9204d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:11.922116 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-933ca495-44f4-4cc5-a460-2cb02e593715 req-8b59ba90-68a5-4b49-96e5-f2fb95f6ce93 service nova] Creating event network-changed:672dff2d-d9db-457b-b48d-9e22194e90c7 for instance 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f on hv-cinder-85282 Aug 12 11:52:11.936629 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-933ca495-44f4-4cc5-a460-2cb02e593715 req-8b59ba90-68a5-4b49-96e5-f2fb95f6ce93 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090401 Aug 12 11:52:11.937988 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 178/356] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:52:12.072581 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-b1fa0555-8480-4af3-8e21-0faff535e195 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:12.073703 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-b1fa0555-8480-4af3-8e21-0faff535e195 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:12.099851 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b1fa0555-8480-4af3-8e21-0faff535e195 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:12.122263 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b1fa0555-8480-4af3-8e21-0faff535e195 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:12.123113 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b1fa0555-8480-4af3-8e21-0faff535e195 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:12.125111 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b1fa0555-8480-4af3-8e21-0faff535e195 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:12.125868 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b1fa0555-8480-4af3-8e21-0faff535e195 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:12.126525 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b1fa0555-8480-4af3-8e21-0faff535e195 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:12.194422 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-22423d99-1cd4-4be3-bf72-88b442b9204d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:12.203769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-22423d99-1cd4-4be3-bf72-88b442b9204d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1522 microversion: 2.1 time: 0.346904 Aug 12 11:52:12.218555 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 179/357] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:11 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:12.294785 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-392c7d14-a29c-4e03-a0cf-84055e7b051d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:12.295769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-392c7d14-a29c-4e03-a0cf-84055e7b051d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:12.303627 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-392c7d14-a29c-4e03-a0cf-84055e7b051d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:12.304579 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-392c7d14-a29c-4e03-a0cf-84055e7b051d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:12.305335 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-392c7d14-a29c-4e03-a0cf-84055e7b051d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:12.307217 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-392c7d14-a29c-4e03-a0cf-84055e7b051d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:12.309516 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-392c7d14-a29c-4e03-a0cf-84055e7b051d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:12.310177 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-392c7d14-a29c-4e03-a0cf-84055e7b051d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:12.713258 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-b1fa0555-8480-4af3-8e21-0faff535e195 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:12.725265 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-b1fa0555-8480-4af3-8e21-0faff535e195 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f" status: 200 len: 1367 microversion: 2.1 time: 0.660514 Aug 12 11:52:12.726126 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 179/358] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:12 2022] GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f => generated 1367 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:12.745315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e33b41fa-1cd5-43c0-9c6c-7d44e32f5564 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:12.746141 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-e33b41fa-1cd5-43c0-9c6c-7d44e32f5564 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:12.752069 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e33b41fa-1cd5-43c0-9c6c-7d44e32f5564 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:12.752548 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e33b41fa-1cd5-43c0-9c6c-7d44e32f5564 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:12.752978 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e33b41fa-1cd5-43c0-9c6c-7d44e32f5564 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:12.753662 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e33b41fa-1cd5-43c0-9c6c-7d44e32f5564 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:12.754200 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e33b41fa-1cd5-43c0-9c6c-7d44e32f5564 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:12.754503 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e33b41fa-1cd5-43c0-9c6c-7d44e32f5564 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:12.900085 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-392c7d14-a29c-4e03-a0cf-84055e7b051d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:12.910456 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-392c7d14-a29c-4e03-a0cf-84055e7b051d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:12.912547 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-392c7d14-a29c-4e03-a0cf-84055e7b051d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:12.914706 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-392c7d14-a29c-4e03-a0cf-84055e7b051d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1724 microversion: 2.20 time: 0.624687 Aug 12 11:52:12.926832 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 180/359] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:12 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1724 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:12.926832 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e7b49071-91f3-4f74-ab1a-d3d0d7a59539 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Action: 'create', calling method: .version_select at 0x7f3e583e9700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-130283437", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpInZHwQK7Nzn86Sr3pE/aR3xCSoFQvTpUFH9bsLY4/DgwAjy9v+YNzDS1W4rm+/SzYDlAalbKSo6GvZq9S2K29M6m9xbz+ggDT2caAqNIUYciaY6Q9mPD67heGanvXzQ=="}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:52:12.937466 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-e7b49071-91f3-4f74-ab1a-d3d0d7a59539 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Getting quotas for project a91d3226406e4f889c7f3abcd37ec490. Resources: {'key_pairs'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:52:12.947110 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-e7b49071-91f3-4f74-ab1a-d3d0d7a59539 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Getting quotas for user 1227fcf8876a4a0d839c4d9c10626c6e and project a91d3226406e4f889c7f3abcd37ec490. Resources: {'key_pairs'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:52:12.978225 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e7b49071-91f3-4f74-ab1a-d3d0d7a59539 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.057839 Aug 12 11:52:12.978878 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 181/360] 10.222.0.42 () {60 vars in 1159 bytes} [Fri Aug 12 11:52:12 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:52:13.005826 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-e33b41fa-1cd5-43c0-9c6c-7d44e32f5564 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:13.017243 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-e33b41fa-1cd5-43c0-9c6c-7d44e32f5564 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1725 microversion: 2.1 time: 0.275619 Aug 12 11:52:13.018795 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 180/361] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:12 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1725 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:13.103219 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-33100247-2da7-45b9-aa0f-3b67cd2af5ee tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1909295989", "imageRef": "9ab08b8d-9fd5-41ca-92c0-c50710b891bb", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-130283437", "networks": [{"uuid": "e9684396-78c3-474b-b88c-e88213488298"}]}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:52:13.162198 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.network.neutron [None req-33100247-2da7-45b9-aa0f-3b67cd2af5ee tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] validate_networks() for [('e9684396-78c3-474b-b88c-e88213488298', None, None, None, None, None)] {{(pid=132282) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 11:52:13.224993 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e4866c31-ce5f-4f28-a425-f70a6251cd23 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:13.225598 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-e4866c31-ce5f-4f28-a425-f70a6251cd23 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:13.231894 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e4866c31-ce5f-4f28-a425-f70a6251cd23 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:13.232589 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e4866c31-ce5f-4f28-a425-f70a6251cd23 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:13.233195 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e4866c31-ce5f-4f28-a425-f70a6251cd23 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:13.234050 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e4866c31-ce5f-4f28-a425-f70a6251cd23 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:13.234702 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e4866c31-ce5f-4f28-a425-f70a6251cd23 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:13.235280 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e4866c31-ce5f-4f28-a425-f70a6251cd23 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:13.443936 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-e4866c31-ce5f-4f28-a425-f70a6251cd23 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:13.451935 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-e4866c31-ce5f-4f28-a425-f70a6251cd23 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1522 microversion: 2.1 time: 0.230694 Aug 12 11:52:13.452496 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 181/362] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:13 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:13.608757 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-33100247-2da7-45b9-aa0f-3b67cd2af5ee tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Flavor limits 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 11:52:13.609165 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-33100247-2da7-45b9-aa0f-3b67cd2af5ee tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Image limits 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 11:52:13.609626 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-33100247-2da7-45b9-aa0f-3b67cd2af5ee tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Flavor pref 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 11:52:13.610023 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-33100247-2da7-45b9-aa0f-3b67cd2af5ee tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Image pref 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 11:52:13.610636 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-33100247-2da7-45b9-aa0f-3b67cd2af5ee tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 11:52:13.619778 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-33100247-2da7-45b9-aa0f-3b67cd2af5ee tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:13.620274 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-33100247-2da7-45b9-aa0f-3b67cd2af5ee tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:13.621215 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-33100247-2da7-45b9-aa0f-3b67cd2af5ee tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:13.622204 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-33100247-2da7-45b9-aa0f-3b67cd2af5ee tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:13.622667 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-33100247-2da7-45b9-aa0f-3b67cd2af5ee tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:13.623085 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-33100247-2da7-45b9-aa0f-3b67cd2af5ee tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:13.639865 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-33100247-2da7-45b9-aa0f-3b67cd2af5ee tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Getting quotas for project a91d3226406e4f889c7f3abcd37ec490. Resources: {'instances', 'ram', 'cores'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:52:13.643758 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-33100247-2da7-45b9-aa0f-3b67cd2af5ee tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Getting quotas for user 1227fcf8876a4a0d839c4d9c10626c6e and project a91d3226406e4f889c7f3abcd37ec490. Resources: {'instances', 'ram', 'cores'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:52:13.654279 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-33100247-2da7-45b9-aa0f-3b67cd2af5ee tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Going to run 1 instances... {{(pid=132282) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 11:52:13.656573 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-33100247-2da7-45b9-aa0f-3b67cd2af5ee tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9ab08b8d-9fd5-41ca-92c0-c50710b891bb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132282) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 11:52:13.701891 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-33100247-2da7-45b9-aa0f-3b67cd2af5ee tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602474 Aug 12 11:52:13.702863 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 182/363] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Aug 12 11:52:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 11:52:13.714185 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-6ddb15ee-3be3-4e70-9faf-fbb230c9d1b5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:13.715645 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-6ddb15ee-3be3-4e70-9faf-fbb230c9d1b5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:13.748145 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-15485da2-76fd-4002-bbb5-a0ddb91ff089 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:13.748914 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-15485da2-76fd-4002-bbb5-a0ddb91ff089 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:13.756052 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-15485da2-76fd-4002-bbb5-a0ddb91ff089 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:13.756759 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-15485da2-76fd-4002-bbb5-a0ddb91ff089 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:13.757313 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-15485da2-76fd-4002-bbb5-a0ddb91ff089 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:13.758721 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-15485da2-76fd-4002-bbb5-a0ddb91ff089 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:13.759302 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-15485da2-76fd-4002-bbb5-a0ddb91ff089 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:13.759833 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-15485da2-76fd-4002-bbb5-a0ddb91ff089 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:13.795341 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-6ddb15ee-3be3-4e70-9faf-fbb230c9d1b5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:13.802902 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-6ddb15ee-3be3-4e70-9faf-fbb230c9d1b5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1258 microversion: 2.1 time: 0.092780 Aug 12 11:52:13.803758 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 182/364] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:13 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1258 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:52:13.940369 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-1298f6b3-2096-4e86-8e3a-5d53fc0c2209 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:13.941196 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-1298f6b3-2096-4e86-8e3a-5d53fc0c2209 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:13.949370 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1298f6b3-2096-4e86-8e3a-5d53fc0c2209 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:13.949978 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1298f6b3-2096-4e86-8e3a-5d53fc0c2209 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:13.950424 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1298f6b3-2096-4e86-8e3a-5d53fc0c2209 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:13.951163 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1298f6b3-2096-4e86-8e3a-5d53fc0c2209 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:13.955933 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-15485da2-76fd-4002-bbb5-a0ddb91ff089 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:13.960352 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1298f6b3-2096-4e86-8e3a-5d53fc0c2209 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:13.960927 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1298f6b3-2096-4e86-8e3a-5d53fc0c2209 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:13.965315 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-15485da2-76fd-4002-bbb5-a0ddb91ff089 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f" status: 200 len: 1367 microversion: 2.1 time: 0.222193 Aug 12 11:52:13.966137 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 183/365] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:13 2022] GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:52:14.039848 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-970bfd97-cc0d-4f12-bd60-9e9109f46a74 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:14.040877 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-970bfd97-cc0d-4f12-bd60-9e9109f46a74 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:14.049281 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-970bfd97-cc0d-4f12-bd60-9e9109f46a74 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:14.050093 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-970bfd97-cc0d-4f12-bd60-9e9109f46a74 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:14.050763 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-970bfd97-cc0d-4f12-bd60-9e9109f46a74 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:14.051559 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-970bfd97-cc0d-4f12-bd60-9e9109f46a74 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:14.052229 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-970bfd97-cc0d-4f12-bd60-9e9109f46a74 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:14.052836 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-970bfd97-cc0d-4f12-bd60-9e9109f46a74 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:14.259603 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-1298f6b3-2096-4e86-8e3a-5d53fc0c2209 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:14.268117 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-1298f6b3-2096-4e86-8e3a-5d53fc0c2209 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:14.269857 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-1298f6b3-2096-4e86-8e3a-5d53fc0c2209 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:14.271053 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-1298f6b3-2096-4e86-8e3a-5d53fc0c2209 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1724 microversion: 2.20 time: 0.337147 Aug 12 11:52:14.272071 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 183/366] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:13 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1724 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:52:14.314867 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-970bfd97-cc0d-4f12-bd60-9e9109f46a74 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:14.323594 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-970bfd97-cc0d-4f12-bd60-9e9109f46a74 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1725 microversion: 2.1 time: 0.288301 Aug 12 11:52:14.324341 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 184/367] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:14 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1725 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:52:14.473407 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-5758fe9c-d510-497c-bcaf-8fc240471797 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:14.474162 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-5758fe9c-d510-497c-bcaf-8fc240471797 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:14.476584 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:14.486248 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5758fe9c-d510-497c-bcaf-8fc240471797 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:14.487978 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5758fe9c-d510-497c-bcaf-8fc240471797 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:14.488953 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5758fe9c-d510-497c-bcaf-8fc240471797 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:14.490931 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5758fe9c-d510-497c-bcaf-8fc240471797 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:14.491399 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5758fe9c-d510-497c-bcaf-8fc240471797 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:14.491835 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5758fe9c-d510-497c-bcaf-8fc240471797 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:14.649927 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-5758fe9c-d510-497c-bcaf-8fc240471797 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:14.658305 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-5758fe9c-d510-497c-bcaf-8fc240471797 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1522 microversion: 2.1 time: 0.188871 Aug 12 11:52:14.658985 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 184/368] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:14 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:14.824787 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-c60dee5c-00d1-4014-a3a4-379e67c58950 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:14.825414 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-c60dee5c-00d1-4014-a3a4-379e67c58950 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:14.831938 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c60dee5c-00d1-4014-a3a4-379e67c58950 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:14.832405 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c60dee5c-00d1-4014-a3a4-379e67c58950 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:14.832834 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c60dee5c-00d1-4014-a3a4-379e67c58950 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:14.833512 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c60dee5c-00d1-4014-a3a4-379e67c58950 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:14.833951 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c60dee5c-00d1-4014-a3a4-379e67c58950 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:14.834364 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c60dee5c-00d1-4014-a3a4-379e67c58950 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:14.912979 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-c60dee5c-00d1-4014-a3a4-379e67c58950 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:14.921016 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-c60dee5c-00d1-4014-a3a4-379e67c58950 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1310 microversion: 2.1 time: 0.100536 Aug 12 11:52:14.921577 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 185/369] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:14 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1310 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:14.985811 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-f87ae8e3-e6e9-4085-95d3-80cbf77abbfa tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:14.986415 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-f87ae8e3-e6e9-4085-95d3-80cbf77abbfa tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:14.993171 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f87ae8e3-e6e9-4085-95d3-80cbf77abbfa tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:14.993660 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f87ae8e3-e6e9-4085-95d3-80cbf77abbfa tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:14.994088 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f87ae8e3-e6e9-4085-95d3-80cbf77abbfa tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:14.994803 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f87ae8e3-e6e9-4085-95d3-80cbf77abbfa tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:14.995416 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f87ae8e3-e6e9-4085-95d3-80cbf77abbfa tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:14.995831 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f87ae8e3-e6e9-4085-95d3-80cbf77abbfa tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:15.129352 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-f87ae8e3-e6e9-4085-95d3-80cbf77abbfa tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:15.137222 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-f87ae8e3-e6e9-4085-95d3-80cbf77abbfa tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f" status: 200 len: 1367 microversion: 2.1 time: 0.155287 Aug 12 11:52:15.137770 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 185/370] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:14 2022] GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:15.294275 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-8fe55fe0-6b6a-459d-ba8b-3f2b6ff519f3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:15.294871 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-8fe55fe0-6b6a-459d-ba8b-3f2b6ff519f3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:15.301093 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8fe55fe0-6b6a-459d-ba8b-3f2b6ff519f3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:15.301573 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8fe55fe0-6b6a-459d-ba8b-3f2b6ff519f3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:15.302011 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8fe55fe0-6b6a-459d-ba8b-3f2b6ff519f3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:15.302744 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8fe55fe0-6b6a-459d-ba8b-3f2b6ff519f3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:15.303198 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8fe55fe0-6b6a-459d-ba8b-3f2b6ff519f3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:15.303620 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8fe55fe0-6b6a-459d-ba8b-3f2b6ff519f3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:15.345688 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e1acd7b5-b740-458e-998a-b03f3b3b32d5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:15.346297 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-e1acd7b5-b740-458e-998a-b03f3b3b32d5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:15.352795 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e1acd7b5-b740-458e-998a-b03f3b3b32d5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:15.353313 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e1acd7b5-b740-458e-998a-b03f3b3b32d5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:15.353945 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e1acd7b5-b740-458e-998a-b03f3b3b32d5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:15.354686 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e1acd7b5-b740-458e-998a-b03f3b3b32d5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:15.355309 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e1acd7b5-b740-458e-998a-b03f3b3b32d5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:15.355998 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e1acd7b5-b740-458e-998a-b03f3b3b32d5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:15.543555 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-8fe55fe0-6b6a-459d-ba8b-3f2b6ff519f3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:15.551940 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-8fe55fe0-6b6a-459d-ba8b-3f2b6ff519f3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:15.553764 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-8fe55fe0-6b6a-459d-ba8b-3f2b6ff519f3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:15.555093 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-8fe55fe0-6b6a-459d-ba8b-3f2b6ff519f3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1724 microversion: 2.20 time: 0.264801 Aug 12 11:52:15.555972 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 186/371] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:15 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:15.572186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-e1acd7b5-b740-458e-998a-b03f3b3b32d5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:15.581308 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-e1acd7b5-b740-458e-998a-b03f3b3b32d5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1725 microversion: 2.1 time: 0.239354 Aug 12 11:52:15.582443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 186/372] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:15 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1725 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:52:15.679925 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d9dce82c-0fe7-4c99-8751-4d10c5eefa21 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:15.680722 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d9dce82c-0fe7-4c99-8751-4d10c5eefa21 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:15.687853 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d9dce82c-0fe7-4c99-8751-4d10c5eefa21 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:15.688347 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d9dce82c-0fe7-4c99-8751-4d10c5eefa21 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:15.688803 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d9dce82c-0fe7-4c99-8751-4d10c5eefa21 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:15.689485 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d9dce82c-0fe7-4c99-8751-4d10c5eefa21 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:15.689941 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d9dce82c-0fe7-4c99-8751-4d10c5eefa21 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:15.690405 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d9dce82c-0fe7-4c99-8751-4d10c5eefa21 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:15.942513 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-b0f0e019-375f-4fc3-bd77-e14936fcb3bc tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:15.943364 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-b0f0e019-375f-4fc3-bd77-e14936fcb3bc tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:15.949555 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b0f0e019-375f-4fc3-bd77-e14936fcb3bc tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:15.950262 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b0f0e019-375f-4fc3-bd77-e14936fcb3bc tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:15.951515 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b0f0e019-375f-4fc3-bd77-e14936fcb3bc tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:15.952480 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b0f0e019-375f-4fc3-bd77-e14936fcb3bc tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:15.952946 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b0f0e019-375f-4fc3-bd77-e14936fcb3bc tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:15.953429 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b0f0e019-375f-4fc3-bd77-e14936fcb3bc tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:16.073762 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-b0f0e019-375f-4fc3-bd77-e14936fcb3bc tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:16.083084 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-b0f0e019-375f-4fc3-bd77-e14936fcb3bc tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1316 microversion: 2.1 time: 0.145252 Aug 12 11:52:16.084073 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 187/373] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:15 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1316 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:16.084919 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d9dce82c-0fe7-4c99-8751-4d10c5eefa21 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:16.098419 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-d9dce82c-0fe7-4c99-8751-4d10c5eefa21 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1522 microversion: 2.1 time: 0.422286 Aug 12 11:52:16.099328 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 187/374] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:15 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:16.158338 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-808728bc-9ca1-4705-af79-05d2554212f1 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:16.158995 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-808728bc-9ca1-4705-af79-05d2554212f1 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:16.164882 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-808728bc-9ca1-4705-af79-05d2554212f1 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:16.165353 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-808728bc-9ca1-4705-af79-05d2554212f1 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:16.165782 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-808728bc-9ca1-4705-af79-05d2554212f1 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:16.166457 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-808728bc-9ca1-4705-af79-05d2554212f1 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:16.166938 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-808728bc-9ca1-4705-af79-05d2554212f1 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:16.167985 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-808728bc-9ca1-4705-af79-05d2554212f1 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:16.293823 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-808728bc-9ca1-4705-af79-05d2554212f1 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:16.301135 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-808728bc-9ca1-4705-af79-05d2554212f1 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f" status: 200 len: 1367 microversion: 2.1 time: 0.146664 Aug 12 11:52:16.301685 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 188/375] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:16 2022] GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:16.579179 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-a1a7a00b-5abd-4c6d-8e03-18b1bb4752b5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:16.580345 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-a1a7a00b-5abd-4c6d-8e03-18b1bb4752b5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:16.587339 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a1a7a00b-5abd-4c6d-8e03-18b1bb4752b5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:16.587831 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a1a7a00b-5abd-4c6d-8e03-18b1bb4752b5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:16.588276 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a1a7a00b-5abd-4c6d-8e03-18b1bb4752b5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:16.588977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a1a7a00b-5abd-4c6d-8e03-18b1bb4752b5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:16.589971 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a1a7a00b-5abd-4c6d-8e03-18b1bb4752b5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:16.590394 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a1a7a00b-5abd-4c6d-8e03-18b1bb4752b5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:16.604865 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e32fbe98-9cf9-49bf-a38c-e152603aa8a5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:16.615051 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-e32fbe98-9cf9-49bf-a38c-e152603aa8a5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:16.621653 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e32fbe98-9cf9-49bf-a38c-e152603aa8a5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:16.622273 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e32fbe98-9cf9-49bf-a38c-e152603aa8a5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:16.623032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e32fbe98-9cf9-49bf-a38c-e152603aa8a5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:16.623958 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e32fbe98-9cf9-49bf-a38c-e152603aa8a5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:16.624412 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e32fbe98-9cf9-49bf-a38c-e152603aa8a5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:16.624838 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e32fbe98-9cf9-49bf-a38c-e152603aa8a5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:16.905764 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-a1a7a00b-5abd-4c6d-8e03-18b1bb4752b5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:16.917726 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-a1a7a00b-5abd-4c6d-8e03-18b1bb4752b5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:16.920018 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-a1a7a00b-5abd-4c6d-8e03-18b1bb4752b5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:16.925538 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-e32fbe98-9cf9-49bf-a38c-e152603aa8a5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:16.935378 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-a1a7a00b-5abd-4c6d-8e03-18b1bb4752b5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1724 microversion: 2.20 time: 0.359924 Aug 12 11:52:16.937983 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 188/376] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:16 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1724 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:16.939125 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-e32fbe98-9cf9-49bf-a38c-e152603aa8a5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1725 microversion: 2.1 time: 0.339645 Aug 12 11:52:16.955044 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 189/377] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:16 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1725 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:52:17.107740 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-f0372429-5a80-4a11-a278-cf839e77a801 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:17.108602 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-f0372429-5a80-4a11-a278-cf839e77a801 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:17.118042 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f0372429-5a80-4a11-a278-cf839e77a801 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:17.119427 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f0372429-5a80-4a11-a278-cf839e77a801 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:17.119876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f0372429-5a80-4a11-a278-cf839e77a801 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:17.125476 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-64677671-155d-4a43-a912-ed356b8a17b6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:17.126031 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-64677671-155d-4a43-a912-ed356b8a17b6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:17.128779 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell0:SELECT=2 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:17.133131 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f0372429-5a80-4a11-a278-cf839e77a801 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:17.133632 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f0372429-5a80-4a11-a278-cf839e77a801 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:17.134068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f0372429-5a80-4a11-a278-cf839e77a801 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:17.140842 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=100 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:17.143275 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-64677671-155d-4a43-a912-ed356b8a17b6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:17.143999 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-64677671-155d-4a43-a912-ed356b8a17b6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:17.144583 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-64677671-155d-4a43-a912-ed356b8a17b6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:17.145462 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-64677671-155d-4a43-a912-ed356b8a17b6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:17.147602 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-64677671-155d-4a43-a912-ed356b8a17b6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:17.149270 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-64677671-155d-4a43-a912-ed356b8a17b6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:17.502244 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-f0372429-5a80-4a11-a278-cf839e77a801 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:17.512402 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-64677671-155d-4a43-a912-ed356b8a17b6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:17.514140 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-f0372429-5a80-4a11-a278-cf839e77a801 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1358 microversion: 2.1 time: 0.412846 Aug 12 11:52:17.519280 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 189/378] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:17 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1358 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:17.519675 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e9d40b7d-41d2-4e28-8400-db87d7358ccc tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:17.520279 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-e9d40b7d-41d2-4e28-8400-db87d7358ccc tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:17.527402 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-64677671-155d-4a43-a912-ed356b8a17b6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1522 microversion: 2.1 time: 0.405843 Aug 12 11:52:17.529314 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 190/379] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:17 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:52:17.534885 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e9d40b7d-41d2-4e28-8400-db87d7358ccc tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:17.535616 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e9d40b7d-41d2-4e28-8400-db87d7358ccc tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:17.536205 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e9d40b7d-41d2-4e28-8400-db87d7358ccc tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:17.537069 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e9d40b7d-41d2-4e28-8400-db87d7358ccc tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:17.537668 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e9d40b7d-41d2-4e28-8400-db87d7358ccc tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:17.538237 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e9d40b7d-41d2-4e28-8400-db87d7358ccc tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:17.759108 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e9d40b7d-41d2-4e28-8400-db87d7358ccc tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:17.769939 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e9d40b7d-41d2-4e28-8400-db87d7358ccc tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f" status: 200 len: 1367 microversion: 2.1 time: 0.253670 Aug 12 11:52:17.770461 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-7ef4c5ff-8386-41d0-874a-76d80052cbc6 req-cd5e5a93-ae4a-477c-a77e-bde9652a74b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f", "name": "network-vif-plugged", "status": "completed", "tag": "672dff2d-d9db-457b-b48d-9e22194e90c7"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:52:17.771805 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 190/380] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:17 2022] GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:17.795778 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-7ef4c5ff-8386-41d0-874a-76d80052cbc6 req-cd5e5a93-ae4a-477c-a77e-bde9652a74b6 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:17.796269 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-7ef4c5ff-8386-41d0-874a-76d80052cbc6 req-cd5e5a93-ae4a-477c-a77e-bde9652a74b6 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:17.796747 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-7ef4c5ff-8386-41d0-874a-76d80052cbc6 req-cd5e5a93-ae4a-477c-a77e-bde9652a74b6 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:17.806379 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:17.815234 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-7ef4c5ff-8386-41d0-874a-76d80052cbc6 req-cd5e5a93-ae4a-477c-a77e-bde9652a74b6 service nova] Creating event network-vif-plugged:672dff2d-d9db-457b-b48d-9e22194e90c7 for instance 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f on hv-cinder-85282 Aug 12 11:52:17.821458 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-7ef4c5ff-8386-41d0-874a-76d80052cbc6 req-cd5e5a93-ae4a-477c-a77e-bde9652a74b6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059133 Aug 12 11:52:17.822495 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 191/381] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:52:17.962000 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-73559607-4f5e-4c5b-9e3a-69e516b87968 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:17.962661 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-73559607-4f5e-4c5b-9e3a-69e516b87968 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:17.967966 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-3559b6e7-bed7-41e3-a849-2ddd3f7374d9 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:17.968856 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-3559b6e7-bed7-41e3-a849-2ddd3f7374d9 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:17.969424 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-73559607-4f5e-4c5b-9e3a-69e516b87968 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:17.970004 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-73559607-4f5e-4c5b-9e3a-69e516b87968 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:17.970513 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-73559607-4f5e-4c5b-9e3a-69e516b87968 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:17.971302 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-73559607-4f5e-4c5b-9e3a-69e516b87968 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:17.971831 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-73559607-4f5e-4c5b-9e3a-69e516b87968 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:17.972327 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-73559607-4f5e-4c5b-9e3a-69e516b87968 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:17.975874 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3559b6e7-bed7-41e3-a849-2ddd3f7374d9 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:17.976549 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3559b6e7-bed7-41e3-a849-2ddd3f7374d9 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:17.977125 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3559b6e7-bed7-41e3-a849-2ddd3f7374d9 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:17.978118 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3559b6e7-bed7-41e3-a849-2ddd3f7374d9 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:17.978765 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3559b6e7-bed7-41e3-a849-2ddd3f7374d9 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:17.979347 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3559b6e7-bed7-41e3-a849-2ddd3f7374d9 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:18.188475 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-73559607-4f5e-4c5b-9e3a-69e516b87968 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:18.197940 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-73559607-4f5e-4c5b-9e3a-69e516b87968 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:18.199687 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-73559607-4f5e-4c5b-9e3a-69e516b87968 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:18.200777 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-3559b6e7-bed7-41e3-a849-2ddd3f7374d9 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:18.201064 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-73559607-4f5e-4c5b-9e3a-69e516b87968 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1724 microversion: 2.20 time: 0.242985 Aug 12 11:52:18.201711 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 191/382] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:17 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:18.209127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-3559b6e7-bed7-41e3-a849-2ddd3f7374d9 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1725 microversion: 2.1 time: 0.245525 Aug 12 11:52:18.209708 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 192/383] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:17 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1725 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:18.535220 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-b2789ab4-530c-43ee-978c-7bff75dad3f3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:18.535935 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-b2789ab4-530c-43ee-978c-7bff75dad3f3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:18.542228 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b2789ab4-530c-43ee-978c-7bff75dad3f3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:18.542822 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b2789ab4-530c-43ee-978c-7bff75dad3f3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:18.543320 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b2789ab4-530c-43ee-978c-7bff75dad3f3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:18.544080 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b2789ab4-530c-43ee-978c-7bff75dad3f3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:18.544593 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b2789ab4-530c-43ee-978c-7bff75dad3f3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:18.545078 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b2789ab4-530c-43ee-978c-7bff75dad3f3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:18.553378 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-17532f1e-1def-4ac6-b131-472ff0844d85 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:18.553988 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-17532f1e-1def-4ac6-b131-472ff0844d85 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:18.565126 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-17532f1e-1def-4ac6-b131-472ff0844d85 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:18.566197 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-17532f1e-1def-4ac6-b131-472ff0844d85 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:18.566855 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-17532f1e-1def-4ac6-b131-472ff0844d85 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:18.567843 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-17532f1e-1def-4ac6-b131-472ff0844d85 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:18.568488 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-17532f1e-1def-4ac6-b131-472ff0844d85 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:18.569059 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-17532f1e-1def-4ac6-b131-472ff0844d85 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:18.761018 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-b2789ab4-530c-43ee-978c-7bff75dad3f3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:18.767831 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-17532f1e-1def-4ac6-b131-472ff0844d85 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:18.769658 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-b2789ab4-530c-43ee-978c-7bff75dad3f3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1358 microversion: 2.1 time: 0.238257 Aug 12 11:52:18.771113 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 192/384] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:18 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:18.779091 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-17532f1e-1def-4ac6-b131-472ff0844d85 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1522 microversion: 2.1 time: 0.229435 Aug 12 11:52:18.788749 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 193/385] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:18 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:18.794797 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-c5446bb2-4747-40e6-8459-ead7c82daebe tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:18.796142 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-c5446bb2-4747-40e6-8459-ead7c82daebe tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:18.803490 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c5446bb2-4747-40e6-8459-ead7c82daebe tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:18.804365 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c5446bb2-4747-40e6-8459-ead7c82daebe tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:18.805163 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c5446bb2-4747-40e6-8459-ead7c82daebe tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:18.806720 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c5446bb2-4747-40e6-8459-ead7c82daebe tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:18.808393 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c5446bb2-4747-40e6-8459-ead7c82daebe tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:18.809365 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c5446bb2-4747-40e6-8459-ead7c82daebe tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:18.948026 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-c5446bb2-4747-40e6-8459-ead7c82daebe tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:18.955931 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-c5446bb2-4747-40e6-8459-ead7c82daebe tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f" status: 200 len: 1367 microversion: 2.1 time: 0.165654 Aug 12 11:52:18.956723 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 193/386] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:18 2022] GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:19.224318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-ec2d41c5-48f5-463a-90ee-3d97e58fa686 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:19.224919 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-ec2d41c5-48f5-463a-90ee-3d97e58fa686 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:19.231797 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-bb1b1fe4-6969-4eb7-a5e6-4d7c3a1c8ce3 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:19.232417 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-bb1b1fe4-6969-4eb7-a5e6-4d7c3a1c8ce3 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:19.235546 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ec2d41c5-48f5-463a-90ee-3d97e58fa686 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:19.236206 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ec2d41c5-48f5-463a-90ee-3d97e58fa686 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:19.236723 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ec2d41c5-48f5-463a-90ee-3d97e58fa686 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:19.237521 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ec2d41c5-48f5-463a-90ee-3d97e58fa686 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:19.238050 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ec2d41c5-48f5-463a-90ee-3d97e58fa686 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:19.238557 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ec2d41c5-48f5-463a-90ee-3d97e58fa686 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:19.238669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bb1b1fe4-6969-4eb7-a5e6-4d7c3a1c8ce3 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:19.239106 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bb1b1fe4-6969-4eb7-a5e6-4d7c3a1c8ce3 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:19.239544 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bb1b1fe4-6969-4eb7-a5e6-4d7c3a1c8ce3 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:19.240238 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bb1b1fe4-6969-4eb7-a5e6-4d7c3a1c8ce3 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:19.240694 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bb1b1fe4-6969-4eb7-a5e6-4d7c3a1c8ce3 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:19.241125 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bb1b1fe4-6969-4eb7-a5e6-4d7c3a1c8ce3 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:19.719394 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-bb1b1fe4-6969-4eb7-a5e6-4d7c3a1c8ce3 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:19.722514 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-ec2d41c5-48f5-463a-90ee-3d97e58fa686 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:19.727497 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-bb1b1fe4-6969-4eb7-a5e6-4d7c3a1c8ce3 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1725 microversion: 2.1 time: 0.499995 Aug 12 11:52:19.728525 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 194/387] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:19 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1725 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:52:19.731028 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-ec2d41c5-48f5-463a-90ee-3d97e58fa686 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:19.732699 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-ec2d41c5-48f5-463a-90ee-3d97e58fa686 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:19.733836 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-ec2d41c5-48f5-463a-90ee-3d97e58fa686 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1724 microversion: 2.20 time: 0.513445 Aug 12 11:52:19.734381 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 194/388] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:19 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1724 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:19.791289 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-54473209-64bd-44b5-a1b5-4208c88f46b4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:19.791894 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-54473209-64bd-44b5-a1b5-4208c88f46b4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:19.798075 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-54473209-64bd-44b5-a1b5-4208c88f46b4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:19.798545 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-54473209-64bd-44b5-a1b5-4208c88f46b4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:19.799009 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-54473209-64bd-44b5-a1b5-4208c88f46b4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:19.799704 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-54473209-64bd-44b5-a1b5-4208c88f46b4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:19.800153 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-54473209-64bd-44b5-a1b5-4208c88f46b4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:19.800575 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-54473209-64bd-44b5-a1b5-4208c88f46b4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:19.801897 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-7b9c59f2-ea0f-42d1-b9bd-9cea324d24c6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:19.802507 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-7b9c59f2-ea0f-42d1-b9bd-9cea324d24c6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:19.810867 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7b9c59f2-ea0f-42d1-b9bd-9cea324d24c6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:19.811702 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7b9c59f2-ea0f-42d1-b9bd-9cea324d24c6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:19.812317 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7b9c59f2-ea0f-42d1-b9bd-9cea324d24c6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:19.813192 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7b9c59f2-ea0f-42d1-b9bd-9cea324d24c6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:19.813884 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7b9c59f2-ea0f-42d1-b9bd-9cea324d24c6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:19.814590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7b9c59f2-ea0f-42d1-b9bd-9cea324d24c6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:20.009880 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-54473209-64bd-44b5-a1b5-4208c88f46b4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:20.014474 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-7b9c59f2-ea0f-42d1-b9bd-9cea324d24c6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:20.019290 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-54473209-64bd-44b5-a1b5-4208c88f46b4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1358 microversion: 2.1 time: 0.231796 Aug 12 11:52:20.020232 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 195/389] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:19 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1358 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:20.022175 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-7b9c59f2-ea0f-42d1-b9bd-9cea324d24c6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1522 microversion: 2.1 time: 0.224766 Aug 12 11:52:20.026005 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-0424464d-14cc-4531-bf49-7fdc7a97049a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:20.027625 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-0424464d-14cc-4531-bf49-7fdc7a97049a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:20.035119 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 195/390] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:19 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:20.038801 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0424464d-14cc-4531-bf49-7fdc7a97049a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:20.039298 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0424464d-14cc-4531-bf49-7fdc7a97049a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:20.039869 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0424464d-14cc-4531-bf49-7fdc7a97049a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:20.040576 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0424464d-14cc-4531-bf49-7fdc7a97049a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:20.041147 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0424464d-14cc-4531-bf49-7fdc7a97049a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:20.041571 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0424464d-14cc-4531-bf49-7fdc7a97049a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:20.178805 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-0424464d-14cc-4531-bf49-7fdc7a97049a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:20.186831 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-0424464d-14cc-4531-bf49-7fdc7a97049a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f" status: 200 len: 1367 microversion: 2.1 time: 0.165411 Aug 12 11:52:20.187400 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 196/391] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:20 2022] GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:20.749225 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-386fdf96-9094-4eb8-b05a-8ffc25c3e94c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:20.749838 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-386fdf96-9094-4eb8-b05a-8ffc25c3e94c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:20.755499 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-5c853fc8-2136-4b7d-b57d-44ad4a8cfe79 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:20.756120 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-5c853fc8-2136-4b7d-b57d-44ad4a8cfe79 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:20.756522 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-386fdf96-9094-4eb8-b05a-8ffc25c3e94c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:20.757011 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-386fdf96-9094-4eb8-b05a-8ffc25c3e94c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:20.757455 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-386fdf96-9094-4eb8-b05a-8ffc25c3e94c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:20.758252 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-386fdf96-9094-4eb8-b05a-8ffc25c3e94c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:20.758666 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-386fdf96-9094-4eb8-b05a-8ffc25c3e94c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:20.759210 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-386fdf96-9094-4eb8-b05a-8ffc25c3e94c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:20.762914 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5c853fc8-2136-4b7d-b57d-44ad4a8cfe79 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:20.763397 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5c853fc8-2136-4b7d-b57d-44ad4a8cfe79 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:20.763833 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5c853fc8-2136-4b7d-b57d-44ad4a8cfe79 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:20.765900 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5c853fc8-2136-4b7d-b57d-44ad4a8cfe79 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:20.765900 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5c853fc8-2136-4b7d-b57d-44ad4a8cfe79 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:20.765900 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5c853fc8-2136-4b7d-b57d-44ad4a8cfe79 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:20.980078 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-5c853fc8-2136-4b7d-b57d-44ad4a8cfe79 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:20.988417 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-386fdf96-9094-4eb8-b05a-8ffc25c3e94c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:20.999994 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-386fdf96-9094-4eb8-b05a-8ffc25c3e94c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1725 microversion: 2.1 time: 0.254437 Aug 12 11:52:21.003133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-5c853fc8-2136-4b7d-b57d-44ad4a8cfe79 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:21.004713 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-5c853fc8-2136-4b7d-b57d-44ad4a8cfe79 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:21.005899 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-5c853fc8-2136-4b7d-b57d-44ad4a8cfe79 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1724 microversion: 2.20 time: 0.254206 Aug 12 11:52:21.006710 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 196/392] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:20 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1725 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:21.007417 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 197/393] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:20 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:52:21.041357 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-1e1e45db-8a47-4258-9b05-4cf257ed4cf3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:21.042038 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-1e1e45db-8a47-4258-9b05-4cf257ed4cf3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:21.042966 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-ffb78793-5e64-43b6-9a5a-191a018d99e5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:21.043743 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-ffb78793-5e64-43b6-9a5a-191a018d99e5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:21.048266 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1e1e45db-8a47-4258-9b05-4cf257ed4cf3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:21.048975 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1e1e45db-8a47-4258-9b05-4cf257ed4cf3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:21.049409 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1e1e45db-8a47-4258-9b05-4cf257ed4cf3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:21.049944 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ffb78793-5e64-43b6-9a5a-191a018d99e5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:21.050106 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1e1e45db-8a47-4258-9b05-4cf257ed4cf3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:21.050545 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ffb78793-5e64-43b6-9a5a-191a018d99e5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:21.050889 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1e1e45db-8a47-4258-9b05-4cf257ed4cf3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:21.051185 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ffb78793-5e64-43b6-9a5a-191a018d99e5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:21.051296 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1e1e45db-8a47-4258-9b05-4cf257ed4cf3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:21.051977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ffb78793-5e64-43b6-9a5a-191a018d99e5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:21.052498 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ffb78793-5e64-43b6-9a5a-191a018d99e5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:21.053849 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ffb78793-5e64-43b6-9a5a-191a018d99e5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:21.257712 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-1e1e45db-8a47-4258-9b05-4cf257ed4cf3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:21.265514 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-ffb78793-5e64-43b6-9a5a-191a018d99e5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:21.266950 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-1e1e45db-8a47-4258-9b05-4cf257ed4cf3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1358 microversion: 2.1 time: 0.229913 Aug 12 11:52:21.267802 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 197/394] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:21 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:21.273011 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-b324c833-c3f0-4299-8305-c2210ef9da91 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:21.273613 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-b324c833-c3f0-4299-8305-c2210ef9da91 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:21.274805 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-ffb78793-5e64-43b6-9a5a-191a018d99e5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1522 microversion: 2.1 time: 0.235783 Aug 12 11:52:21.275382 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 198/395] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:21 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:52:21.283357 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b324c833-c3f0-4299-8305-c2210ef9da91 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:21.283357 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b324c833-c3f0-4299-8305-c2210ef9da91 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:21.283357 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b324c833-c3f0-4299-8305-c2210ef9da91 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:21.283357 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b324c833-c3f0-4299-8305-c2210ef9da91 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:21.283800 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b324c833-c3f0-4299-8305-c2210ef9da91 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:21.283800 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b324c833-c3f0-4299-8305-c2210ef9da91 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:21.423911 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-b324c833-c3f0-4299-8305-c2210ef9da91 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:21.431883 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-b324c833-c3f0-4299-8305-c2210ef9da91 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f" status: 200 len: 1367 microversion: 2.1 time: 0.162489 Aug 12 11:52:21.433734 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 198/396] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:21 2022] GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:22.028007 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-56dbf62a-3e0a-4e96-a600-96cf9ee9f1d6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:22.028581 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-56dbf62a-3e0a-4e96-a600-96cf9ee9f1d6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:22.029866 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-f429d562-ed82-4632-bd42-20a2cc1a6c1a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:22.030821 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-f429d562-ed82-4632-bd42-20a2cc1a6c1a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:22.035230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-56dbf62a-3e0a-4e96-a600-96cf9ee9f1d6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:22.035725 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-56dbf62a-3e0a-4e96-a600-96cf9ee9f1d6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:22.036162 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-56dbf62a-3e0a-4e96-a600-96cf9ee9f1d6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:22.036860 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-56dbf62a-3e0a-4e96-a600-96cf9ee9f1d6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:22.037314 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-56dbf62a-3e0a-4e96-a600-96cf9ee9f1d6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:22.037736 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-56dbf62a-3e0a-4e96-a600-96cf9ee9f1d6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:22.037837 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f429d562-ed82-4632-bd42-20a2cc1a6c1a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:22.038244 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f429d562-ed82-4632-bd42-20a2cc1a6c1a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:22.038706 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f429d562-ed82-4632-bd42-20a2cc1a6c1a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:22.039443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f429d562-ed82-4632-bd42-20a2cc1a6c1a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:22.039898 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f429d562-ed82-4632-bd42-20a2cc1a6c1a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:22.040522 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f429d562-ed82-4632-bd42-20a2cc1a6c1a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:22.262532 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-f429d562-ed82-4632-bd42-20a2cc1a6c1a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:22.265193 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-56dbf62a-3e0a-4e96-a600-96cf9ee9f1d6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:22.273598 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-56dbf62a-3e0a-4e96-a600-96cf9ee9f1d6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1725 microversion: 2.1 time: 0.249314 Aug 12 11:52:22.274466 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 199/397] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:22 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1725 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:22.274672 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-f429d562-ed82-4632-bd42-20a2cc1a6c1a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:22.276986 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-f429d562-ed82-4632-bd42-20a2cc1a6c1a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:22.278399 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-f429d562-ed82-4632-bd42-20a2cc1a6c1a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1724 microversion: 2.20 time: 0.252262 Aug 12 11:52:22.287317 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 199/398] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:22 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:22.294546 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-7c92edb2-298f-4ec1-b1d3-2ceccc509b6e tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:22.295195 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-7c92edb2-298f-4ec1-b1d3-2ceccc509b6e tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:22.297228 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-5227a12f-6ab1-49d1-9ce9-9f17b81eed26 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:22.298131 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-5227a12f-6ab1-49d1-9ce9-9f17b81eed26 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:22.304257 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5227a12f-6ab1-49d1-9ce9-9f17b81eed26 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:22.304830 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5227a12f-6ab1-49d1-9ce9-9f17b81eed26 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:22.305328 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7c92edb2-298f-4ec1-b1d3-2ceccc509b6e tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:22.305459 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5227a12f-6ab1-49d1-9ce9-9f17b81eed26 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:22.305808 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7c92edb2-298f-4ec1-b1d3-2ceccc509b6e tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:22.306230 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5227a12f-6ab1-49d1-9ce9-9f17b81eed26 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:22.306327 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7c92edb2-298f-4ec1-b1d3-2ceccc509b6e tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:22.306835 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5227a12f-6ab1-49d1-9ce9-9f17b81eed26 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:22.306941 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7c92edb2-298f-4ec1-b1d3-2ceccc509b6e tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:22.307670 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5227a12f-6ab1-49d1-9ce9-9f17b81eed26 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:22.307781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7c92edb2-298f-4ec1-b1d3-2ceccc509b6e tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:22.308279 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7c92edb2-298f-4ec1-b1d3-2ceccc509b6e tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:22.514125 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-7c92edb2-298f-4ec1-b1d3-2ceccc509b6e tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:22.517566 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-5227a12f-6ab1-49d1-9ce9-9f17b81eed26 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:22.522142 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-7c92edb2-298f-4ec1-b1d3-2ceccc509b6e tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1358 microversion: 2.1 time: 0.235888 Aug 12 11:52:22.523294 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 200/399] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:22 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:22.528816 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-049b0599-d4d6-4215-837f-19a9e8e81ce4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:22.529518 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-049b0599-d4d6-4215-837f-19a9e8e81ce4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:22.535739 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-049b0599-d4d6-4215-837f-19a9e8e81ce4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:22.536222 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-049b0599-d4d6-4215-837f-19a9e8e81ce4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:22.536650 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-049b0599-d4d6-4215-837f-19a9e8e81ce4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:22.537342 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-049b0599-d4d6-4215-837f-19a9e8e81ce4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:22.537912 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-049b0599-d4d6-4215-837f-19a9e8e81ce4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:22.538219 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-049b0599-d4d6-4215-837f-19a9e8e81ce4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:22.540458 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-5227a12f-6ab1-49d1-9ce9-9f17b81eed26 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1522 microversion: 2.1 time: 0.247786 Aug 12 11:52:22.554301 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 200/400] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:22 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:52:22.699803 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-049b0599-d4d6-4215-837f-19a9e8e81ce4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:22.707640 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-049b0599-d4d6-4215-837f-19a9e8e81ce4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f" status: 200 len: 1367 microversion: 2.1 time: 0.183074 Aug 12 11:52:22.708582 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 201/401] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:22 2022] GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:23.298598 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-b1626e78-3e19-4802-9e6b-22ba4157d7f2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:23.299267 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-b1626e78-3e19-4802-9e6b-22ba4157d7f2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:23.305908 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b1626e78-3e19-4802-9e6b-22ba4157d7f2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:23.312073 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-90723583-20cd-468a-b7d1-2aacc2d7896e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:23.312777 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-90723583-20cd-468a-b7d1-2aacc2d7896e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:23.316321 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b1626e78-3e19-4802-9e6b-22ba4157d7f2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:23.316846 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b1626e78-3e19-4802-9e6b-22ba4157d7f2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:23.317578 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b1626e78-3e19-4802-9e6b-22ba4157d7f2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:23.318063 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b1626e78-3e19-4802-9e6b-22ba4157d7f2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:23.318480 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b1626e78-3e19-4802-9e6b-22ba4157d7f2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:23.322941 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-90723583-20cd-468a-b7d1-2aacc2d7896e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:23.323426 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-90723583-20cd-468a-b7d1-2aacc2d7896e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:23.323865 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-90723583-20cd-468a-b7d1-2aacc2d7896e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:23.324572 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-90723583-20cd-468a-b7d1-2aacc2d7896e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:23.325771 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-90723583-20cd-468a-b7d1-2aacc2d7896e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:23.325771 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-90723583-20cd-468a-b7d1-2aacc2d7896e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:23.548018 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-b1626e78-3e19-4802-9e6b-22ba4157d7f2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:23.552787 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-90723583-20cd-468a-b7d1-2aacc2d7896e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:23.557346 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-b1626e78-3e19-4802-9e6b-22ba4157d7f2 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1725 microversion: 2.1 time: 0.262332 Aug 12 11:52:23.559396 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 201/402] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:23 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1725 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:52:23.566095 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-3ca9664b-5acd-41e6-80f9-2f98a90d99a9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:23.566743 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-3ca9664b-5acd-41e6-80f9-2f98a90d99a9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:23.573369 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3ca9664b-5acd-41e6-80f9-2f98a90d99a9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:23.573864 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3ca9664b-5acd-41e6-80f9-2f98a90d99a9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:23.574321 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3ca9664b-5acd-41e6-80f9-2f98a90d99a9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:23.575058 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3ca9664b-5acd-41e6-80f9-2f98a90d99a9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:23.575517 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3ca9664b-5acd-41e6-80f9-2f98a90d99a9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:23.575951 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3ca9664b-5acd-41e6-80f9-2f98a90d99a9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:23.581146 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-90723583-20cd-468a-b7d1-2aacc2d7896e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:23.583660 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-90723583-20cd-468a-b7d1-2aacc2d7896e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:23.584904 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-90723583-20cd-468a-b7d1-2aacc2d7896e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1724 microversion: 2.20 time: 0.277530 Aug 12 11:52:23.596419 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 202/403] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:23 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1724 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:52:23.601097 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-40a24995-cfbc-4b88-ad52-f43ff6974236 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:23.601710 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-40a24995-cfbc-4b88-ad52-f43ff6974236 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:23.619936 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-40a24995-cfbc-4b88-ad52-f43ff6974236 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:23.620457 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-40a24995-cfbc-4b88-ad52-f43ff6974236 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:23.620916 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-40a24995-cfbc-4b88-ad52-f43ff6974236 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:23.621610 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-40a24995-cfbc-4b88-ad52-f43ff6974236 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:23.622059 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-40a24995-cfbc-4b88-ad52-f43ff6974236 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:23.622480 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-40a24995-cfbc-4b88-ad52-f43ff6974236 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:23.648759 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=2 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:23.653244 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=12 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:23.782418 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-3ca9664b-5acd-41e6-80f9-2f98a90d99a9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:23.790283 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-3ca9664b-5acd-41e6-80f9-2f98a90d99a9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1358 microversion: 2.1 time: 0.229404 Aug 12 11:52:23.791075 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 202/404] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:23 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:23.796098 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-948cd00e-c4c1-4dff-b49b-0dc51882b127 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:23.796705 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-948cd00e-c4c1-4dff-b49b-0dc51882b127 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:23.802032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell0:SELECT=12 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:23.803564 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-948cd00e-c4c1-4dff-b49b-0dc51882b127 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:23.804369 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-948cd00e-c4c1-4dff-b49b-0dc51882b127 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:23.804497 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-948cd00e-c4c1-4dff-b49b-0dc51882b127 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:23.805241 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-948cd00e-c4c1-4dff-b49b-0dc51882b127 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:23.805701 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-948cd00e-c4c1-4dff-b49b-0dc51882b127 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:23.806246 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-948cd00e-c4c1-4dff-b49b-0dc51882b127 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:23.839402 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-40a24995-cfbc-4b88-ad52-f43ff6974236 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:23.847558 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-40a24995-cfbc-4b88-ad52-f43ff6974236 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1522 microversion: 2.1 time: 0.250184 Aug 12 11:52:23.852797 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 203/405] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:23 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:23.985789 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-948cd00e-c4c1-4dff-b49b-0dc51882b127 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:23.993866 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-948cd00e-c4c1-4dff-b49b-0dc51882b127 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f" status: 200 len: 1367 microversion: 2.1 time: 0.201932 Aug 12 11:52:23.994545 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 203/406] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:23 2022] GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:24.581388 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-95e12d46-3da3-4353-bcc8-6e38b0e25562 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:24.581994 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-95e12d46-3da3-4353-bcc8-6e38b0e25562 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:24.588420 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-95e12d46-3da3-4353-bcc8-6e38b0e25562 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:24.588903 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-95e12d46-3da3-4353-bcc8-6e38b0e25562 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:24.589338 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-95e12d46-3da3-4353-bcc8-6e38b0e25562 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:24.590025 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-95e12d46-3da3-4353-bcc8-6e38b0e25562 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:24.590474 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-95e12d46-3da3-4353-bcc8-6e38b0e25562 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:24.590965 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-95e12d46-3da3-4353-bcc8-6e38b0e25562 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:24.611604 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-79ba49cd-7a40-4e0c-b713-384f40e0b42b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:24.612634 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-79ba49cd-7a40-4e0c-b713-384f40e0b42b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:24.619389 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-79ba49cd-7a40-4e0c-b713-384f40e0b42b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:24.620585 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-79ba49cd-7a40-4e0c-b713-384f40e0b42b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:24.621086 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-79ba49cd-7a40-4e0c-b713-384f40e0b42b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:24.621928 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-79ba49cd-7a40-4e0c-b713-384f40e0b42b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:24.622441 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-79ba49cd-7a40-4e0c-b713-384f40e0b42b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:24.622945 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-79ba49cd-7a40-4e0c-b713-384f40e0b42b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:24.786369 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-95e12d46-3da3-4353-bcc8-6e38b0e25562 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:24.796232 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-95e12d46-3da3-4353-bcc8-6e38b0e25562 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1725 microversion: 2.1 time: 0.218636 Aug 12 11:52:24.797070 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 204/407] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:24 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:24.811850 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-79ba49cd-7a40-4e0c-b713-384f40e0b42b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:24.813656 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-efe11682-7a5b-42f0-b2c0-8892a8acbea7 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:24.814265 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-efe11682-7a5b-42f0-b2c0-8892a8acbea7 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:24.819832 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-79ba49cd-7a40-4e0c-b713-384f40e0b42b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:24.819986 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-efe11682-7a5b-42f0-b2c0-8892a8acbea7 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:24.820448 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-efe11682-7a5b-42f0-b2c0-8892a8acbea7 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:24.820885 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-efe11682-7a5b-42f0-b2c0-8892a8acbea7 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:24.821351 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-79ba49cd-7a40-4e0c-b713-384f40e0b42b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:24.821581 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-efe11682-7a5b-42f0-b2c0-8892a8acbea7 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:24.822037 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-efe11682-7a5b-42f0-b2c0-8892a8acbea7 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:24.822461 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-efe11682-7a5b-42f0-b2c0-8892a8acbea7 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:24.822565 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-79ba49cd-7a40-4e0c-b713-384f40e0b42b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1724 microversion: 2.20 time: 0.216826 Aug 12 11:52:24.823096 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 204/408] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:24 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:24.876898 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-3f3629a4-4720-4523-a1f7-f12c6c4b69a4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:24.877503 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-3f3629a4-4720-4523-a1f7-f12c6c4b69a4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:24.883575 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3f3629a4-4720-4523-a1f7-f12c6c4b69a4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:24.884061 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3f3629a4-4720-4523-a1f7-f12c6c4b69a4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:24.884497 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3f3629a4-4720-4523-a1f7-f12c6c4b69a4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:24.885184 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3f3629a4-4720-4523-a1f7-f12c6c4b69a4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:24.886148 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3f3629a4-4720-4523-a1f7-f12c6c4b69a4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:24.886590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3f3629a4-4720-4523-a1f7-f12c6c4b69a4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:24.995641 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-efe11682-7a5b-42f0-b2c0-8892a8acbea7 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:24.999075 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=100 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:25.004305 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-efe11682-7a5b-42f0-b2c0-8892a8acbea7 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1358 microversion: 2.1 time: 0.194347 Aug 12 11:52:25.004868 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 205/409] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:24 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:25.021564 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-960e28cf-58c5-45c0-aa04-ff3fe8ab7344 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:25.022165 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-960e28cf-58c5-45c0-aa04-ff3fe8ab7344 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:25.029377 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-960e28cf-58c5-45c0-aa04-ff3fe8ab7344 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:25.029855 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-960e28cf-58c5-45c0-aa04-ff3fe8ab7344 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:25.030283 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-960e28cf-58c5-45c0-aa04-ff3fe8ab7344 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:25.030992 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-960e28cf-58c5-45c0-aa04-ff3fe8ab7344 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:25.031438 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-960e28cf-58c5-45c0-aa04-ff3fe8ab7344 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:25.031864 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-960e28cf-58c5-45c0-aa04-ff3fe8ab7344 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:25.041589 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-3f3629a4-4720-4523-a1f7-f12c6c4b69a4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:25.049099 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-3f3629a4-4720-4523-a1f7-f12c6c4b69a4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1522 microversion: 2.1 time: 0.176002 Aug 12 11:52:25.049660 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 205/410] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:24 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:25.159418 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-960e28cf-58c5-45c0-aa04-ff3fe8ab7344 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:25.166533 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-960e28cf-58c5-45c0-aa04-ff3fe8ab7344 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f" status: 200 len: 1367 microversion: 2.1 time: 0.148626 Aug 12 11:52:25.167127 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 206/411] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:25 2022] GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:52:25.818084 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-3dfae1c9-b459-47f4-a063-aaf72506ee1e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:25.818725 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-3dfae1c9-b459-47f4-a063-aaf72506ee1e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:25.825154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3dfae1c9-b459-47f4-a063-aaf72506ee1e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:25.825628 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3dfae1c9-b459-47f4-a063-aaf72506ee1e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:25.826059 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3dfae1c9-b459-47f4-a063-aaf72506ee1e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:25.826767 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3dfae1c9-b459-47f4-a063-aaf72506ee1e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:25.827210 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3dfae1c9-b459-47f4-a063-aaf72506ee1e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:25.827624 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3dfae1c9-b459-47f4-a063-aaf72506ee1e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:25.850701 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e2f0921c-412a-4c72-9fbb-e059f445a842 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:25.851525 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-e2f0921c-412a-4c72-9fbb-e059f445a842 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:25.858216 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e2f0921c-412a-4c72-9fbb-e059f445a842 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:25.858728 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e2f0921c-412a-4c72-9fbb-e059f445a842 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:25.859165 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e2f0921c-412a-4c72-9fbb-e059f445a842 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:25.859862 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e2f0921c-412a-4c72-9fbb-e059f445a842 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:25.860321 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e2f0921c-412a-4c72-9fbb-e059f445a842 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:25.860739 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e2f0921c-412a-4c72-9fbb-e059f445a842 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:26.071062 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-3dfae1c9-b459-47f4-a063-aaf72506ee1e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:26.079366 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-3dfae1c9-b459-47f4-a063-aaf72506ee1e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1702 microversion: 2.1 time: 0.265038 Aug 12 11:52:26.079946 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 206/412] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:25 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1702 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:26.084465 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-75cbe5a5-eef8-40fb-944f-cebeae139aa9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:26.085624 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-75cbe5a5-eef8-40fb-944f-cebeae139aa9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:26.091534 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-75cbe5a5-eef8-40fb-944f-cebeae139aa9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:26.092022 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-75cbe5a5-eef8-40fb-944f-cebeae139aa9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:26.092458 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-75cbe5a5-eef8-40fb-944f-cebeae139aa9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:26.093155 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-75cbe5a5-eef8-40fb-944f-cebeae139aa9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:26.093606 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-75cbe5a5-eef8-40fb-944f-cebeae139aa9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:26.094216 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-75cbe5a5-eef8-40fb-944f-cebeae139aa9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:26.115629 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e2f0921c-412a-4c72-9fbb-e059f445a842 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:26.124166 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e2f0921c-412a-4c72-9fbb-e059f445a842 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:26.125776 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e2f0921c-412a-4c72-9fbb-e059f445a842 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:26.127042 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e2f0921c-412a-4c72-9fbb-e059f445a842 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1724 microversion: 2.20 time: 0.280241 Aug 12 11:52:26.128152 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 207/413] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:25 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:26.133659 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-cd313d2d-3a1c-47d3-bf0d-b714cb96ea38 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:26.134791 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-cd313d2d-3a1c-47d3-bf0d-b714cb96ea38 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:26.142432 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cd313d2d-3a1c-47d3-bf0d-b714cb96ea38 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:26.143463 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cd313d2d-3a1c-47d3-bf0d-b714cb96ea38 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:26.143918 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cd313d2d-3a1c-47d3-bf0d-b714cb96ea38 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:26.144628 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cd313d2d-3a1c-47d3-bf0d-b714cb96ea38 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:26.145087 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cd313d2d-3a1c-47d3-bf0d-b714cb96ea38 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:26.145515 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cd313d2d-3a1c-47d3-bf0d-b714cb96ea38 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:26.399346 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-75cbe5a5-eef8-40fb-944f-cebeae139aa9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:26.407440 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-75cbe5a5-eef8-40fb-944f-cebeae139aa9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1358 microversion: 2.1 time: 0.326525 Aug 12 11:52:26.408004 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 207/414] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:26 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1358 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:26.412437 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-4da49dab-cc95-4db1-8f1d-af2e0b8bd61d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:52:26.418314 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4da49dab-cc95-4db1-8f1d-af2e0b8bd61d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:26.418824 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4da49dab-cc95-4db1-8f1d-af2e0b8bd61d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:26.419261 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4da49dab-cc95-4db1-8f1d-af2e0b8bd61d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:26.430921 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-cd313d2d-3a1c-47d3-bf0d-b714cb96ea38 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:26.439841 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-cd313d2d-3a1c-47d3-bf0d-b714cb96ea38 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1502 microversion: 2.1 time: 0.311103 Aug 12 11:52:26.440418 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 208/415] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:26 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1502 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:26.441906 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=100 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:26.446086 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-725bf6aa-fe16-419e-aee9-ef219cfe50c2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:26.446728 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-725bf6aa-fe16-419e-aee9-ef219cfe50c2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:26.453607 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-725bf6aa-fe16-419e-aee9-ef219cfe50c2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:26.454097 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-725bf6aa-fe16-419e-aee9-ef219cfe50c2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:26.454531 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-725bf6aa-fe16-419e-aee9-ef219cfe50c2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:26.455798 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-725bf6aa-fe16-419e-aee9-ef219cfe50c2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:26.455926 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-725bf6aa-fe16-419e-aee9-ef219cfe50c2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:26.456315 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-725bf6aa-fe16-419e-aee9-ef219cfe50c2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:26.461286 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-4da49dab-cc95-4db1-8f1d-af2e0b8bd61d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Going to try to start instance {{(pid=132281) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 12 11:52:26.513921 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-4da49dab-cc95-4db1-8f1d-af2e0b8bd61d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "POST /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db/action" status: 202 len: 0 microversion: 2.1 time: 0.104647 Aug 12 11:52:26.514568 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 208/416] 10.222.0.42 () {60 vars in 1278 bytes} [Fri Aug 12 11:52:26 2022] POST /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:52:26.520092 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-bce2ac47-bab2-423e-adda-65e3f404b828 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14e4a361-0aaa-4053-afeb-069f84840cb8"}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:52:26.522552 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-bce2ac47-bab2-423e-adda-65e3f404b828 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:26.530010 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bce2ac47-bab2-423e-adda-65e3f404b828 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:26.530666 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bce2ac47-bab2-423e-adda-65e3f404b828 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:26.531444 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bce2ac47-bab2-423e-adda-65e3f404b828 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:26.532252 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bce2ac47-bab2-423e-adda-65e3f404b828 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:26.532937 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bce2ac47-bab2-423e-adda-65e3f404b828 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:26.533366 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bce2ac47-bab2-423e-adda-65e3f404b828 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:26.559489 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.wsgi [None req-bce2ac47-bab2-423e-adda-65e3f404b828 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] HTTP exception thrown: Cannot 'attach_volume' instance 5109a18a-e7ab-4ce9-904b-63c1dfc7197a while it is in vm_state rescued Aug 12 11:52:26.561580 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-bce2ac47-bab2-423e-adda-65e3f404b828 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Request method failure captured: Aug 12 11:52:26.561580 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: POST /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a/os-volume_attachments HTTP/1.1 Aug 12 11:52:26.561580 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 11:52:26.561580 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 11:52:26.561580 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 11:52:26.561580 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 74 Aug 12 11:52:26.561580 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 11:52:26.561580 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 11:52:26.561580 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 11:52:26.561580 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 11:52:26.561580 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9j5mt6PNioe5iUGgp3CAkbSyYo_AhdYrVYhlzDi6Qs9O2Aks8er4C3JcoLHmjMk4ocUEKhdotNj2qgtAdK9WiQzA1AjEiu4Ps5qMdbbFZI3icMtnprp3XMTKgh0QwzwvvdyNK5uaTpRPPinF6P3wPdnin1wNbpohTf1mbuSCDgZlVZU Aug 12 11:52:26.561580 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 11:52:26.561580 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 11:52:26.561580 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 11:52:26.561580 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 11:52:26.561580 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 11:52:26.561580 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 11:52:26.561580 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: a7e2fce9e9db463aa70188453f20d110 Aug 12 11:52:26.561580 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-758473035 Aug 12 11:52:26.561580 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 11:52:26.561580 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 11:52:26.563219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a7e2fce9e9db463aa70188453f20d110", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a7e2fce9e9db463aa70188453f20d110"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7e2fce9e9db463aa70188453f20d110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7e2fce9e9db463aa70188453f20d110"}]}] Aug 12 11:52:26.563219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-ServerRescueNegativeTestJSON-758473035 Aug 12 11:52:26.563219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: a7e2fce9e9db463aa70188453f20d110 Aug 12 11:52:26.563219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-758473035 Aug 12 11:52:26.563219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-ServerRescueNegativeTestJSON-758473035-project Aug 12 11:52:26.563219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 11:52:26.563219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 11:52:26.563219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: 64ec7445644e478ca961be80f84f9863 Aug 12 11:52:26.563219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-ServerRescueNegativeTestJSON-758473035-project Aug 12 11:52:26.563219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Aug 12 11:52:26.563219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {"volumeAttachment": {"volumeId": "14e4a361-0aaa-4053-afeb-069f84840cb8"}} Aug 12 11:52:26.563219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: > Aug 12 11:52:26.564267 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Cannot 'attach_volume' instance 5109a18a-e7ab-4ce9-904b-63c1dfc7197a while it is in vm_state rescued Aug 12 11:52:26.564267 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'server_id': '5109a18a-e7ab-4ce9-904b-63c1dfc7197a', 'body': {'volumeAttachment': {'volumeId': '14e4a361-0aaa-4053-afeb-069f84840cb8'}}} Aug 12 11:52:26.564267 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:52:26.564267 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:52:26.564267 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 12 11:52:26.564267 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 12 11:52:26.564267 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 12 11:52:26.564267 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 12 11:52:26.564267 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 12 11:52:26.564267 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 12 11:52:26.564267 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5109a18a-e7ab-4ce9-904b-63c1dfc7197a in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 12 11:52:26.564267 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:52:26.564267 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:52:26.564267 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:52:26.564267 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:52:26.564267 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:52:26.564267 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:52:26.564267 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:52:26.564267 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:52:26.565674 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:52:26.565674 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:52:26.565674 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 11:52:26.565674 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 11:52:26.565674 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 11:52:26.565674 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 11:52:26.565674 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 11:52:26.565674 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 11:52:26.565674 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 12 11:52:26.565674 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 12 11:52:26.565674 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 12 11:52:26.565674 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 12 11:52:26.565674 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5109a18a-e7ab-4ce9-904b-63c1dfc7197a while it is in vm_state rescued Aug 12 11:52:26.565674 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:52:26.565674 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:52:26.565674 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:52:26.565674 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:52:26.565674 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:52:26.565674 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:52:26.567110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:52:26.567110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:52:26.567110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5109a18a-e7ab-4ce9-904b-63c1dfc7197a while it is in vm_state rescued Aug 12 11:52:26.567110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:52:26.567110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-bce2ac47-bab2-423e-adda-65e3f404b828 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Returning 409 to user: Cannot 'attach_volume' instance 5109a18a-e7ab-4ce9-904b-63c1dfc7197a while it is in vm_state rescued {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:52:26.567110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-bce2ac47-bab2-423e-adda-65e3f404b828 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "POST /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047232 Aug 12 11:52:26.567110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 209/417] 10.222.0.42 () {60 vars in 1323 bytes} [Fri Aug 12 11:52:26 2022] POST /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 12 11:52:26.567715 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e0f5330d-0d28-40e9-b6da-20a33c261173 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:26.568303 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-e0f5330d-0d28-40e9-b6da-20a33c261173 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:26.575544 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e0f5330d-0d28-40e9-b6da-20a33c261173 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:26.576276 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e0f5330d-0d28-40e9-b6da-20a33c261173 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:26.576710 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e0f5330d-0d28-40e9-b6da-20a33c261173 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:26.577410 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e0f5330d-0d28-40e9-b6da-20a33c261173 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:26.577861 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e0f5330d-0d28-40e9-b6da-20a33c261173 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:26.578277 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e0f5330d-0d28-40e9-b6da-20a33c261173 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:26.809531 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-725bf6aa-fe16-419e-aee9-ef219cfe50c2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:26.816885 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-725bf6aa-fe16-419e-aee9-ef219cfe50c2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f" status: 200 len: 1367 microversion: 2.1 time: 0.375027 Aug 12 11:52:26.817377 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 209/418] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:26 2022] GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:26.821979 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-9694198a-5081-42b4-ae1a-abe7c46aa9ca tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:52:26.822505 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-9694198a-5081-42b4-ae1a-abe7c46aa9ca tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:26.829456 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9694198a-5081-42b4-ae1a-abe7c46aa9ca tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:26.829745 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9694198a-5081-42b4-ae1a-abe7c46aa9ca tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:26.830173 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9694198a-5081-42b4-ae1a-abe7c46aa9ca tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:26.830898 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9694198a-5081-42b4-ae1a-abe7c46aa9ca tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:26.831347 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9694198a-5081-42b4-ae1a-abe7c46aa9ca tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:26.831762 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9694198a-5081-42b4-ae1a-abe7c46aa9ca tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:26.858130 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-e0f5330d-0d28-40e9-b6da-20a33c261173 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:26.872386 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-e0f5330d-0d28-40e9-b6da-20a33c261173 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1711 microversion: 2.1 time: 0.307445 Aug 12 11:52:26.873709 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 210/419] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:26 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1711 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:26.930342 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-9694198a-5081-42b4-ae1a-abe7c46aa9ca tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "POST /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a/action" status: 202 len: 0 microversion: 2.1 time: 0.111774 Aug 12 11:52:26.931006 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 210/420] 10.222.0.42 () {60 vars in 1278 bytes} [Fri Aug 12 11:52:26 2022] POST /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:52:26.939941 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-adcfe606-80a1-4f8d-a1ec-7e319d006914 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:26.940539 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-adcfe606-80a1-4f8d-a1ec-7e319d006914 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:26.946312 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-adcfe606-80a1-4f8d-a1ec-7e319d006914 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:26.947096 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-adcfe606-80a1-4f8d-a1ec-7e319d006914 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:26.947810 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-adcfe606-80a1-4f8d-a1ec-7e319d006914 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:26.949079 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-adcfe606-80a1-4f8d-a1ec-7e319d006914 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:26.949526 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-adcfe606-80a1-4f8d-a1ec-7e319d006914 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:26.950141 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-adcfe606-80a1-4f8d-a1ec-7e319d006914 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:27.105057 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-883aae76-ea55-43cb-8bb3-aa548a9916ac req-6dd09fd5-31d8-437e-a979-0a56b2f05701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e", "tag": "c541547f-b103-4c29-8532-035ca341eb76"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:52:27.114992 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-883aae76-ea55-43cb-8bb3-aa548a9916ac req-6dd09fd5-31d8-437e-a979-0a56b2f05701 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:27.115466 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-883aae76-ea55-43cb-8bb3-aa548a9916ac req-6dd09fd5-31d8-437e-a979-0a56b2f05701 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:27.115893 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-883aae76-ea55-43cb-8bb3-aa548a9916ac req-6dd09fd5-31d8-437e-a979-0a56b2f05701 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:27.127436 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-883aae76-ea55-43cb-8bb3-aa548a9916ac req-6dd09fd5-31d8-437e-a979-0a56b2f05701 service nova] Creating event network-changed:c541547f-b103-4c29-8532-035ca341eb76 for instance 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e on hv-cinder-85282 Aug 12 11:52:27.132531 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-883aae76-ea55-43cb-8bb3-aa548a9916ac req-6dd09fd5-31d8-437e-a979-0a56b2f05701 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033151 Aug 12 11:52:27.133595 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 211/421] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:52:27.153213 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-6c30d863-1af5-4879-86ee-122ac714d4f8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:27.154076 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-6c30d863-1af5-4879-86ee-122ac714d4f8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:27.160184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6c30d863-1af5-4879-86ee-122ac714d4f8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:27.160675 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6c30d863-1af5-4879-86ee-122ac714d4f8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:27.161115 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6c30d863-1af5-4879-86ee-122ac714d4f8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:27.161832 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6c30d863-1af5-4879-86ee-122ac714d4f8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:27.162301 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6c30d863-1af5-4879-86ee-122ac714d4f8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:27.162763 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6c30d863-1af5-4879-86ee-122ac714d4f8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:27.277967 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-adcfe606-80a1-4f8d-a1ec-7e319d006914 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:27.285406 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-adcfe606-80a1-4f8d-a1ec-7e319d006914 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1510 microversion: 2.1 time: 0.349357 Aug 12 11:52:27.286204 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 211/422] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:26 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1510 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:27.332686 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-6c30d863-1af5-4879-86ee-122ac714d4f8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:27.341020 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-6c30d863-1af5-4879-86ee-122ac714d4f8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:27.342547 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-6c30d863-1af5-4879-86ee-122ac714d4f8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:27.343720 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-6c30d863-1af5-4879-86ee-122ac714d4f8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1745 microversion: 2.20 time: 0.194812 Aug 12 11:52:27.344269 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 212/423] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:27 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1745 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:52:27.427399 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-f79fb6b2-5b80-46ad-b73e-4f4147f5e4d5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:27.428005 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-f79fb6b2-5b80-46ad-b73e-4f4147f5e4d5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:27.434096 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f79fb6b2-5b80-46ad-b73e-4f4147f5e4d5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:27.434577 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f79fb6b2-5b80-46ad-b73e-4f4147f5e4d5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:27.435039 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f79fb6b2-5b80-46ad-b73e-4f4147f5e4d5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:27.435723 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f79fb6b2-5b80-46ad-b73e-4f4147f5e4d5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:27.436169 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f79fb6b2-5b80-46ad-b73e-4f4147f5e4d5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:27.436586 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f79fb6b2-5b80-46ad-b73e-4f4147f5e4d5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:27.716391 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-f79fb6b2-5b80-46ad-b73e-4f4147f5e4d5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:27.726023 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-f79fb6b2-5b80-46ad-b73e-4f4147f5e4d5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1358 microversion: 2.1 time: 0.302285 Aug 12 11:52:27.727273 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 212/424] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:27 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1358 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:27.838396 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-dd14dbfa-09fc-4b20-a8a8-5ef47ece21cb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:27.839709 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-dd14dbfa-09fc-4b20-a8a8-5ef47ece21cb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:27.841657 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:27.847226 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-dd14dbfa-09fc-4b20-a8a8-5ef47ece21cb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:27.847708 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-dd14dbfa-09fc-4b20-a8a8-5ef47ece21cb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:27.848145 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-dd14dbfa-09fc-4b20-a8a8-5ef47ece21cb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:27.848837 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-dd14dbfa-09fc-4b20-a8a8-5ef47ece21cb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:27.849291 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-dd14dbfa-09fc-4b20-a8a8-5ef47ece21cb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:27.849719 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-dd14dbfa-09fc-4b20-a8a8-5ef47ece21cb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:27.898926 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-53589ddb-0317-4855-8b8e-6330dbeed6ad tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:27.899527 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-53589ddb-0317-4855-8b8e-6330dbeed6ad tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:27.906223 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-53589ddb-0317-4855-8b8e-6330dbeed6ad tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:27.906736 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-53589ddb-0317-4855-8b8e-6330dbeed6ad tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:27.907165 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-53589ddb-0317-4855-8b8e-6330dbeed6ad tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:27.907841 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-53589ddb-0317-4855-8b8e-6330dbeed6ad tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:27.908284 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-53589ddb-0317-4855-8b8e-6330dbeed6ad tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:27.908701 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-53589ddb-0317-4855-8b8e-6330dbeed6ad tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:28.020631 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-dd14dbfa-09fc-4b20-a8a8-5ef47ece21cb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:28.028730 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-dd14dbfa-09fc-4b20-a8a8-5ef47ece21cb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f" status: 200 len: 1367 microversion: 2.1 time: 0.193977 Aug 12 11:52:28.042276 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 213/425] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:27 2022] GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:28.229195 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-53589ddb-0317-4855-8b8e-6330dbeed6ad tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:28.237239 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-53589ddb-0317-4855-8b8e-6330dbeed6ad tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1711 microversion: 2.1 time: 0.342343 Aug 12 11:52:28.237802 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 213/426] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:27 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1711 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:52:28.306828 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-416d0c3d-d391-4a1a-98ff-8c91ebc1827b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:28.308180 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-416d0c3d-d391-4a1a-98ff-8c91ebc1827b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:28.314408 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-416d0c3d-d391-4a1a-98ff-8c91ebc1827b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:28.314933 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-416d0c3d-d391-4a1a-98ff-8c91ebc1827b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:28.315363 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-416d0c3d-d391-4a1a-98ff-8c91ebc1827b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:28.316054 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-416d0c3d-d391-4a1a-98ff-8c91ebc1827b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:28.316504 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-416d0c3d-d391-4a1a-98ff-8c91ebc1827b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:28.316926 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-416d0c3d-d391-4a1a-98ff-8c91ebc1827b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:28.366492 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-2e86f18e-d752-43f7-9969-5fbc8eba7f63 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:28.367230 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-2e86f18e-d752-43f7-9969-5fbc8eba7f63 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:28.373947 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2e86f18e-d752-43f7-9969-5fbc8eba7f63 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:28.374520 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2e86f18e-d752-43f7-9969-5fbc8eba7f63 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:28.375051 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2e86f18e-d752-43f7-9969-5fbc8eba7f63 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:28.375831 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2e86f18e-d752-43f7-9969-5fbc8eba7f63 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:28.376341 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2e86f18e-d752-43f7-9969-5fbc8eba7f63 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:28.376824 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2e86f18e-d752-43f7-9969-5fbc8eba7f63 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:28.824370 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-2e86f18e-d752-43f7-9969-5fbc8eba7f63 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:28.827351 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-416d0c3d-d391-4a1a-98ff-8c91ebc1827b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:28.833366 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-2e86f18e-d752-43f7-9969-5fbc8eba7f63 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:28.834733 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-416d0c3d-d391-4a1a-98ff-8c91ebc1827b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1510 microversion: 2.1 time: 0.531823 Aug 12 11:52:28.834883 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-2e86f18e-d752-43f7-9969-5fbc8eba7f63 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:28.835302 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 214/427] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:28 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1510 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:28.836388 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-2e86f18e-d752-43f7-9969-5fbc8eba7f63 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1745 microversion: 2.20 time: 0.473791 Aug 12 11:52:28.837128 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 214/428] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:28 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1745 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:52:28.853450 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e3e88d75-bcec-4fa6-a22c-2818fc4e2b10 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:28.854061 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-e3e88d75-bcec-4fa6-a22c-2818fc4e2b10 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:28.860561 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e3e88d75-bcec-4fa6-a22c-2818fc4e2b10 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:28.861041 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e3e88d75-bcec-4fa6-a22c-2818fc4e2b10 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:28.861473 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e3e88d75-bcec-4fa6-a22c-2818fc4e2b10 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:28.862161 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e3e88d75-bcec-4fa6-a22c-2818fc4e2b10 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:28.862814 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e3e88d75-bcec-4fa6-a22c-2818fc4e2b10 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:28.863265 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e3e88d75-bcec-4fa6-a22c-2818fc4e2b10 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:28.992897 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e3e88d75-bcec-4fa6-a22c-2818fc4e2b10 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:29.000203 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e3e88d75-bcec-4fa6-a22c-2818fc4e2b10 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1358 microversion: 2.1 time: 0.152615 Aug 12 11:52:29.000762 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 215/429] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:28 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:29.049036 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-61d4dab2-56ab-443e-b605-5b20236a9804 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:29.049641 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-61d4dab2-56ab-443e-b605-5b20236a9804 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:29.055495 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-61d4dab2-56ab-443e-b605-5b20236a9804 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:29.055963 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-61d4dab2-56ab-443e-b605-5b20236a9804 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:29.056385 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-61d4dab2-56ab-443e-b605-5b20236a9804 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:29.057056 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-61d4dab2-56ab-443e-b605-5b20236a9804 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:29.057784 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-61d4dab2-56ab-443e-b605-5b20236a9804 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:29.058195 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-61d4dab2-56ab-443e-b605-5b20236a9804 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:29.183664 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-61d4dab2-56ab-443e-b605-5b20236a9804 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:29.191197 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-61d4dab2-56ab-443e-b605-5b20236a9804 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f" status: 200 len: 1557 microversion: 2.1 time: 0.145927 Aug 12 11:52:29.191761 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 215/430] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:29 2022] GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:29.211859 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-588d5864-8bdd-4f18-802b-137b3a3c994d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:29.212359 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-588d5864-8bdd-4f18-802b-137b3a3c994d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:29.218910 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-588d5864-8bdd-4f18-802b-137b3a3c994d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:29.219393 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-588d5864-8bdd-4f18-802b-137b3a3c994d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:29.219831 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-588d5864-8bdd-4f18-802b-137b3a3c994d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:29.220518 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-588d5864-8bdd-4f18-802b-137b3a3c994d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:29.220970 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-588d5864-8bdd-4f18-802b-137b3a3c994d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:29.221395 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-588d5864-8bdd-4f18-802b-137b3a3c994d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:29.258321 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-d823365d-bcb2-457f-bffb-380e0281d3f7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:29.258892 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-d823365d-bcb2-457f-bffb-380e0281d3f7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:29.264839 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d823365d-bcb2-457f-bffb-380e0281d3f7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:29.265327 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d823365d-bcb2-457f-bffb-380e0281d3f7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:29.265762 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d823365d-bcb2-457f-bffb-380e0281d3f7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:29.266495 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d823365d-bcb2-457f-bffb-380e0281d3f7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:29.266977 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d823365d-bcb2-457f-bffb-380e0281d3f7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:29.267401 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d823365d-bcb2-457f-bffb-380e0281d3f7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:29.452166 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-588d5864-8bdd-4f18-802b-137b3a3c994d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.244056 Aug 12 11:52:29.459993 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 216/431] 10.222.0.42 () {58 vars in 1275 bytes} [Fri Aug 12 11:52:29 2022] GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f/os-interface => generated 284 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:52:29.744876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-61bad47f-97df-4f91-b3d3-7d915d888ef9 req-7c945200-0c07-4083-aaa8-2837ec3f8de9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712bb3a1-789a-442f-8d59-a635f0896531", "name": "network-vif-plugged", "status": "completed", "tag": "0a1aa4d3-f810-4d8a-b28b-30a0d82ce0c9"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:52:29.769183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-61bad47f-97df-4f91-b3d3-7d915d888ef9 req-7c945200-0c07-4083-aaa8-2837ec3f8de9 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:29.769399 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-61bad47f-97df-4f91-b3d3-7d915d888ef9 req-7c945200-0c07-4083-aaa8-2837ec3f8de9 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:29.769747 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-61bad47f-97df-4f91-b3d3-7d915d888ef9 req-7c945200-0c07-4083-aaa8-2837ec3f8de9 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:29.782025 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-61bad47f-97df-4f91-b3d3-7d915d888ef9 req-7c945200-0c07-4083-aaa8-2837ec3f8de9 service nova] Creating event network-vif-plugged:0a1aa4d3-f810-4d8a-b28b-30a0d82ce0c9 for instance 712bb3a1-789a-442f-8d59-a635f0896531 on hv-cinder-85282 Aug 12 11:52:29.788514 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-61bad47f-97df-4f91-b3d3-7d915d888ef9 req-7c945200-0c07-4083-aaa8-2837ec3f8de9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046888 Aug 12 11:52:29.790699 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 217/432] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:52:29.805151 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-d823365d-bcb2-457f-bffb-380e0281d3f7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:29.814102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-d823365d-bcb2-457f-bffb-380e0281d3f7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1711 microversion: 2.1 time: 0.559493 Aug 12 11:52:29.831460 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 216/433] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:29 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1711 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:52:29.861777 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-11ab1673-062d-46b6-bd78-16ac66fd1af7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:29.862797 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-11ab1673-062d-46b6-bd78-16ac66fd1af7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:29.868600 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-7f928722-8a43-4a8e-94ec-eeb09526b352 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:29.875319 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-11ab1673-062d-46b6-bd78-16ac66fd1af7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:29.875319 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-11ab1673-062d-46b6-bd78-16ac66fd1af7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:29.875776 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-11ab1673-062d-46b6-bd78-16ac66fd1af7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:29.876754 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-11ab1673-062d-46b6-bd78-16ac66fd1af7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:29.878421 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-11ab1673-062d-46b6-bd78-16ac66fd1af7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:29.878952 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-11ab1673-062d-46b6-bd78-16ac66fd1af7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:29.879580 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-7f928722-8a43-4a8e-94ec-eeb09526b352 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:29.887705 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7f928722-8a43-4a8e-94ec-eeb09526b352 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:29.888404 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7f928722-8a43-4a8e-94ec-eeb09526b352 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:29.889640 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7f928722-8a43-4a8e-94ec-eeb09526b352 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:29.890539 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7f928722-8a43-4a8e-94ec-eeb09526b352 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:29.891177 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7f928722-8a43-4a8e-94ec-eeb09526b352 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:29.891751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7f928722-8a43-4a8e-94ec-eeb09526b352 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:30.163386 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-11ab1673-062d-46b6-bd78-16ac66fd1af7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:30.171595 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-11ab1673-062d-46b6-bd78-16ac66fd1af7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1510 microversion: 2.1 time: 0.314381 Aug 12 11:52:30.175029 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 217/434] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:29 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1510 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:30.190558 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-a043a331-2561-4454-9c18-0c21f6ed4eed tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:30.195791 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-7f928722-8a43-4a8e-94ec-eeb09526b352 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:30.206289 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-7f928722-8a43-4a8e-94ec-eeb09526b352 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:30.207061 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-a043a331-2561-4454-9c18-0c21f6ed4eed tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:30.211703 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-7f928722-8a43-4a8e-94ec-eeb09526b352 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:30.217609 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-7f928722-8a43-4a8e-94ec-eeb09526b352 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1740 microversion: 2.20 time: 0.361352 Aug 12 11:52:30.220646 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 218/435] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:29 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1740 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:30.221441 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a043a331-2561-4454-9c18-0c21f6ed4eed tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:30.222883 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a043a331-2561-4454-9c18-0c21f6ed4eed tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:30.223407 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a043a331-2561-4454-9c18-0c21f6ed4eed tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:30.224204 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a043a331-2561-4454-9c18-0c21f6ed4eed tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:30.224748 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a043a331-2561-4454-9c18-0c21f6ed4eed tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:30.225257 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a043a331-2561-4454-9c18-0c21f6ed4eed tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:30.477275 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-a043a331-2561-4454-9c18-0c21f6ed4eed tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:30.486141 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-a043a331-2561-4454-9c18-0c21f6ed4eed tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1358 microversion: 2.1 time: 0.309744 Aug 12 11:52:30.487053 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 218/436] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:30 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1358 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:30.707165 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-f13c202b-b9e2-4648-8502-0b5cc9072f62 req-50bc92ec-88a1-447e-8c82-834d5324dc92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f", "tag": "672dff2d-d9db-457b-b48d-9e22194e90c7"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:52:30.717578 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-f13c202b-b9e2-4648-8502-0b5cc9072f62 req-50bc92ec-88a1-447e-8c82-834d5324dc92 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:30.718342 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-f13c202b-b9e2-4648-8502-0b5cc9072f62 req-50bc92ec-88a1-447e-8c82-834d5324dc92 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:30.719007 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-f13c202b-b9e2-4648-8502-0b5cc9072f62 req-50bc92ec-88a1-447e-8c82-834d5324dc92 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:30.733375 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-f13c202b-b9e2-4648-8502-0b5cc9072f62 req-50bc92ec-88a1-447e-8c82-834d5324dc92 service nova] Creating event network-changed:672dff2d-d9db-457b-b48d-9e22194e90c7 for instance 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f on hv-cinder-85282 Aug 12 11:52:30.740903 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-f13c202b-b9e2-4648-8502-0b5cc9072f62 req-50bc92ec-88a1-447e-8c82-834d5324dc92 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036924 Aug 12 11:52:30.744544 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 219/437] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:52:30.845420 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-f577d709-2fef-41fa-9716-13b42de51359 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:30.846404 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-f577d709-2fef-41fa-9716-13b42de51359 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:30.852888 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f577d709-2fef-41fa-9716-13b42de51359 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:30.853634 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f577d709-2fef-41fa-9716-13b42de51359 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:30.854808 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f577d709-2fef-41fa-9716-13b42de51359 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:30.862119 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f577d709-2fef-41fa-9716-13b42de51359 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:30.862119 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f577d709-2fef-41fa-9716-13b42de51359 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:30.862563 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f577d709-2fef-41fa-9716-13b42de51359 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:31.079157 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-f577d709-2fef-41fa-9716-13b42de51359 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:31.088357 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-f577d709-2fef-41fa-9716-13b42de51359 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1711 microversion: 2.1 time: 0.252473 Aug 12 11:52:31.089632 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 219/438] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:30 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1711 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:31.197052 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-a99266f8-7c6b-4759-b5b3-10e6f7e9b32b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:31.197935 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-a99266f8-7c6b-4759-b5b3-10e6f7e9b32b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:31.218067 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a99266f8-7c6b-4759-b5b3-10e6f7e9b32b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:31.219261 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a99266f8-7c6b-4759-b5b3-10e6f7e9b32b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:31.219860 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a99266f8-7c6b-4759-b5b3-10e6f7e9b32b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:31.224882 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a99266f8-7c6b-4759-b5b3-10e6f7e9b32b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:31.226102 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a99266f8-7c6b-4759-b5b3-10e6f7e9b32b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:31.227068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a99266f8-7c6b-4759-b5b3-10e6f7e9b32b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:31.241455 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-6367e39b-cd19-4ed1-b30b-2b1b07183042 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:31.243038 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-6367e39b-cd19-4ed1-b30b-2b1b07183042 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:31.252288 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6367e39b-cd19-4ed1-b30b-2b1b07183042 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:31.253007 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6367e39b-cd19-4ed1-b30b-2b1b07183042 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:31.254090 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6367e39b-cd19-4ed1-b30b-2b1b07183042 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:31.256064 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6367e39b-cd19-4ed1-b30b-2b1b07183042 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:31.257049 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6367e39b-cd19-4ed1-b30b-2b1b07183042 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:31.257785 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6367e39b-cd19-4ed1-b30b-2b1b07183042 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:31.554220 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-a99266f8-7c6b-4759-b5b3-10e6f7e9b32b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:31.561453 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-6367e39b-cd19-4ed1-b30b-2b1b07183042 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:31.563528 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-a99266f8-7c6b-4759-b5b3-10e6f7e9b32b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1510 microversion: 2.1 time: 0.372510 Aug 12 11:52:31.569820 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-6367e39b-cd19-4ed1-b30b-2b1b07183042 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:31.572465 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-6367e39b-cd19-4ed1-b30b-2b1b07183042 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:31.573868 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-6367e39b-cd19-4ed1-b30b-2b1b07183042 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1740 microversion: 2.20 time: 0.336896 Aug 12 11:52:31.586722 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 220/439] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:31 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1740 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:31.586722 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-af7e7b46-9775-4f85-8e54-24f8808579c1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:31.586722 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-af7e7b46-9775-4f85-8e54-24f8808579c1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:31.587111 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 220/440] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:31 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1510 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:31.587214 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-af7e7b46-9775-4f85-8e54-24f8808579c1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:31.587214 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-af7e7b46-9775-4f85-8e54-24f8808579c1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:31.587499 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-af7e7b46-9775-4f85-8e54-24f8808579c1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:31.588275 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-af7e7b46-9775-4f85-8e54-24f8808579c1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:31.588862 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-af7e7b46-9775-4f85-8e54-24f8808579c1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:31.589373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-af7e7b46-9775-4f85-8e54-24f8808579c1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:31.755314 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-af7e7b46-9775-4f85-8e54-24f8808579c1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:31.762284 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-af7e7b46-9775-4f85-8e54-24f8808579c1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1358 microversion: 2.1 time: 0.186243 Aug 12 11:52:31.763162 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 221/441] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:31 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:32.111799 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-5811331e-5759-4c54-a38e-26d6551b6cd1 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:32.112987 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-5811331e-5759-4c54-a38e-26d6551b6cd1 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:32.126194 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5811331e-5759-4c54-a38e-26d6551b6cd1 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:32.127099 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5811331e-5759-4c54-a38e-26d6551b6cd1 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:32.128295 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5811331e-5759-4c54-a38e-26d6551b6cd1 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:32.130375 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5811331e-5759-4c54-a38e-26d6551b6cd1 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:32.131196 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5811331e-5759-4c54-a38e-26d6551b6cd1 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:32.132086 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5811331e-5759-4c54-a38e-26d6551b6cd1 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:32.278906 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-5811331e-5759-4c54-a38e-26d6551b6cd1 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:32.288502 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-5811331e-5759-4c54-a38e-26d6551b6cd1 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1711 microversion: 2.1 time: 0.180728 Aug 12 11:52:32.289336 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 221/442] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:32 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1711 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:32.589165 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-d9dd1d64-e025-47e0-8160-63115baa1ecd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:32.590477 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-d9dd1d64-e025-47e0-8160-63115baa1ecd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:32.595644 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-9ad28f13-05cd-421d-b5b8-3eefde165d4c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:32.596249 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-9ad28f13-05cd-421d-b5b8-3eefde165d4c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:32.602798 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9ad28f13-05cd-421d-b5b8-3eefde165d4c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:32.603522 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9ad28f13-05cd-421d-b5b8-3eefde165d4c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:32.604195 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9ad28f13-05cd-421d-b5b8-3eefde165d4c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:32.606031 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9ad28f13-05cd-421d-b5b8-3eefde165d4c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:32.606802 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9ad28f13-05cd-421d-b5b8-3eefde165d4c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:32.606936 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d9dd1d64-e025-47e0-8160-63115baa1ecd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:32.607331 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d9dd1d64-e025-47e0-8160-63115baa1ecd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:32.607775 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9ad28f13-05cd-421d-b5b8-3eefde165d4c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:32.608132 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d9dd1d64-e025-47e0-8160-63115baa1ecd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:32.609681 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d9dd1d64-e025-47e0-8160-63115baa1ecd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:32.610371 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d9dd1d64-e025-47e0-8160-63115baa1ecd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:32.611023 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d9dd1d64-e025-47e0-8160-63115baa1ecd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:32.833677 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-d9dd1d64-e025-47e0-8160-63115baa1ecd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:32.842386 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-d9dd1d64-e025-47e0-8160-63115baa1ecd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1510 microversion: 2.1 time: 0.257344 Aug 12 11:52:32.846874 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 222/443] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:32 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1510 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:32.847047 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-9ad28f13-05cd-421d-b5b8-3eefde165d4c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:32.853010 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-2e1b0933-c374-429c-a78e-7ea788d82647 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:32.853613 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-2e1b0933-c374-429c-a78e-7ea788d82647 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:32.855398 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-9ad28f13-05cd-421d-b5b8-3eefde165d4c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:32.857310 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-9ad28f13-05cd-421d-b5b8-3eefde165d4c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:32.859170 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-9ad28f13-05cd-421d-b5b8-3eefde165d4c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1740 microversion: 2.20 time: 0.266834 Aug 12 11:52:32.870630 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2e1b0933-c374-429c-a78e-7ea788d82647 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:32.870630 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2e1b0933-c374-429c-a78e-7ea788d82647 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:32.870630 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2e1b0933-c374-429c-a78e-7ea788d82647 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:32.870630 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2e1b0933-c374-429c-a78e-7ea788d82647 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:32.871055 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2e1b0933-c374-429c-a78e-7ea788d82647 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:32.871055 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2e1b0933-c374-429c-a78e-7ea788d82647 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:32.872255 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 222/444] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:32 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1740 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:33.007989 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-2e1b0933-c374-429c-a78e-7ea788d82647 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:33.016523 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-2e1b0933-c374-429c-a78e-7ea788d82647 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1358 microversion: 2.1 time: 0.172452 Aug 12 11:52:33.017312 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 223/445] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:32 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:33.314812 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-8005de18-5241-48fc-aff2-9dfed3285bdc tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:33.315594 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-8005de18-5241-48fc-aff2-9dfed3285bdc tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:33.322406 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8005de18-5241-48fc-aff2-9dfed3285bdc tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:33.322925 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8005de18-5241-48fc-aff2-9dfed3285bdc tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:33.324037 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8005de18-5241-48fc-aff2-9dfed3285bdc tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:33.325504 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8005de18-5241-48fc-aff2-9dfed3285bdc tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:33.326001 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8005de18-5241-48fc-aff2-9dfed3285bdc tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:33.326593 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8005de18-5241-48fc-aff2-9dfed3285bdc tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:33.500401 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-8005de18-5241-48fc-aff2-9dfed3285bdc tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:33.504298 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:33.512599 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-8005de18-5241-48fc-aff2-9dfed3285bdc tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1715 microversion: 2.1 time: 0.202510 Aug 12 11:52:33.513570 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 223/446] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:33 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1715 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:33.868155 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-0ea156fe-0c8c-4e5f-a891-a7fde6cfd0cd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:33.868753 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-0ea156fe-0c8c-4e5f-a891-a7fde6cfd0cd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:33.876243 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0ea156fe-0c8c-4e5f-a891-a7fde6cfd0cd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:33.876793 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0ea156fe-0c8c-4e5f-a891-a7fde6cfd0cd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:33.877462 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0ea156fe-0c8c-4e5f-a891-a7fde6cfd0cd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:33.878958 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0ea156fe-0c8c-4e5f-a891-a7fde6cfd0cd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:33.879405 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0ea156fe-0c8c-4e5f-a891-a7fde6cfd0cd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:33.880004 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0ea156fe-0c8c-4e5f-a891-a7fde6cfd0cd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:33.885318 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-a90aabe9-801b-43b6-a390-6cc3463c032d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:33.886054 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-a90aabe9-801b-43b6-a390-6cc3463c032d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:33.897760 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a90aabe9-801b-43b6-a390-6cc3463c032d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:33.898469 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a90aabe9-801b-43b6-a390-6cc3463c032d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:33.899036 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a90aabe9-801b-43b6-a390-6cc3463c032d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:33.899854 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:33.900722 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a90aabe9-801b-43b6-a390-6cc3463c032d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:33.901356 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a90aabe9-801b-43b6-a390-6cc3463c032d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:33.901957 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a90aabe9-801b-43b6-a390-6cc3463c032d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:34.193097 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-0ea156fe-0c8c-4e5f-a891-a7fde6cfd0cd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:34.202263 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-0ea156fe-0c8c-4e5f-a891-a7fde6cfd0cd tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1516 microversion: 2.1 time: 0.337823 Aug 12 11:52:34.222624 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 224/447] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:33 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1516 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:34.222624 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-66c3a769-7ac6-49b9-804f-88550d875438 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:34.222624 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-66c3a769-7ac6-49b9-804f-88550d875438 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:34.223103 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-a90aabe9-801b-43b6-a390-6cc3463c032d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:34.223212 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-66c3a769-7ac6-49b9-804f-88550d875438 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:34.223212 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-66c3a769-7ac6-49b9-804f-88550d875438 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:34.223212 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-66c3a769-7ac6-49b9-804f-88550d875438 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:34.223212 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-66c3a769-7ac6-49b9-804f-88550d875438 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:34.223483 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-66c3a769-7ac6-49b9-804f-88550d875438 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:34.223483 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-66c3a769-7ac6-49b9-804f-88550d875438 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:34.226778 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-a90aabe9-801b-43b6-a390-6cc3463c032d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:34.230630 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-a90aabe9-801b-43b6-a390-6cc3463c032d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:34.230630 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-a90aabe9-801b-43b6-a390-6cc3463c032d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1740 microversion: 2.20 time: 0.348541 Aug 12 11:52:34.254870 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 224/448] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:33 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1740 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:52:34.394551 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-66c3a769-7ac6-49b9-804f-88550d875438 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:34.404008 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-66c3a769-7ac6-49b9-804f-88550d875438 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1358 microversion: 2.1 time: 0.195031 Aug 12 11:52:34.404799 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 225/449] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:34 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:35.272079 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d71545d4-f34c-4a47-813c-300b9d6b117a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:35.272822 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d71545d4-f34c-4a47-813c-300b9d6b117a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:35.280772 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d71545d4-f34c-4a47-813c-300b9d6b117a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:35.281352 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d71545d4-f34c-4a47-813c-300b9d6b117a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:35.281866 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d71545d4-f34c-4a47-813c-300b9d6b117a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:35.282683 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d71545d4-f34c-4a47-813c-300b9d6b117a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:35.283220 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d71545d4-f34c-4a47-813c-300b9d6b117a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:35.283807 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d71545d4-f34c-4a47-813c-300b9d6b117a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:35.426199 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-a1adda0f-75fd-4df9-8740-de5e4811f29a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:35.427033 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-a1adda0f-75fd-4df9-8740-de5e4811f29a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:35.439772 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a1adda0f-75fd-4df9-8740-de5e4811f29a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:35.440612 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a1adda0f-75fd-4df9-8740-de5e4811f29a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:35.440889 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a1adda0f-75fd-4df9-8740-de5e4811f29a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:35.447244 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a1adda0f-75fd-4df9-8740-de5e4811f29a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:35.448756 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a1adda0f-75fd-4df9-8740-de5e4811f29a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:35.449560 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a1adda0f-75fd-4df9-8740-de5e4811f29a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:35.479704 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d71545d4-f34c-4a47-813c-300b9d6b117a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:35.507681 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d71545d4-f34c-4a47-813c-300b9d6b117a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:35.510287 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d71545d4-f34c-4a47-813c-300b9d6b117a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:35.513124 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-d71545d4-f34c-4a47-813c-300b9d6b117a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1740 microversion: 2.20 time: 0.244865 Aug 12 11:52:35.514015 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 225/450] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:35 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1740 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:35.615809 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-a1adda0f-75fd-4df9-8740-de5e4811f29a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:35.624723 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-a1adda0f-75fd-4df9-8740-de5e4811f29a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1358 microversion: 2.1 time: 0.204016 Aug 12 11:52:35.634033 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 226/451] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:35 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:35.770899 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-a8cc80dc-2322-423e-b6bc-6f45f5ed8e31 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Action: 'create', calling method: .version_select at 0x7f3e583c4310>, body: {"keypair": {"name": "tempest-keypair-1657146943", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoxewMJvtJ+kvUJ/DWcesxKWhy2ITjxmCHvnJOiRNHdxKgdbQ7QPFRorZXtliJV8jtMKpDs7zQ9RbMheHi0N8GN7OT/iwTRRdHaC2SDh15/FGEYdWWvs03OABV3YWRiqA=="}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:52:35.816305 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-a8cc80dc-2322-423e-b6bc-6f45f5ed8e31 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Getting quotas for project a7e2fce9e9db463aa70188453f20d110. Resources: {'key_pairs'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:52:35.837171 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-a8cc80dc-2322-423e-b6bc-6f45f5ed8e31 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Getting quotas for user 64ec7445644e478ca961be80f84f9863 and project a7e2fce9e9db463aa70188453f20d110. Resources: {'key_pairs'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:52:35.899436 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-36952d42-1fdf-4edb-b69a-3f0dec9062ec req-6fa0c25b-862c-4794-8db7-d3de42f39b41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e", "name": "network-vif-plugged", "status": "completed", "tag": "c541547f-b103-4c29-8532-035ca341eb76"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:52:35.922921 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-a8cc80dc-2322-423e-b6bc-6f45f5ed8e31 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.163921 Aug 12 11:52:35.924011 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 226/452] 10.222.0.42 () {60 vars in 1159 bytes} [Fri Aug 12 11:52:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:52:35.924483 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-36952d42-1fdf-4edb-b69a-3f0dec9062ec req-6fa0c25b-862c-4794-8db7-d3de42f39b41 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:35.924983 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-36952d42-1fdf-4edb-b69a-3f0dec9062ec req-6fa0c25b-862c-4794-8db7-d3de42f39b41 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:35.925417 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-36952d42-1fdf-4edb-b69a-3f0dec9062ec req-6fa0c25b-862c-4794-8db7-d3de42f39b41 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:35.951842 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-36952d42-1fdf-4edb-b69a-3f0dec9062ec req-6fa0c25b-862c-4794-8db7-d3de42f39b41 service nova] Creating event network-vif-plugged:c541547f-b103-4c29-8532-035ca341eb76 for instance 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e on hv-cinder-85282 Aug 12 11:52:35.951842 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-36952d42-1fdf-4edb-b69a-3f0dec9062ec req-6fa0c25b-862c-4794-8db7-d3de42f39b41 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048372 Aug 12 11:52:35.951842 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 227/453] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:52:36.539632 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-9d335e26-879e-4711-b143-cb1377e41cea tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:36.540570 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-9d335e26-879e-4711-b143-cb1377e41cea tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:36.548348 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9d335e26-879e-4711-b143-cb1377e41cea tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:36.548881 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9d335e26-879e-4711-b143-cb1377e41cea tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:36.549472 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9d335e26-879e-4711-b143-cb1377e41cea tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:36.550182 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9d335e26-879e-4711-b143-cb1377e41cea tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:36.550914 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9d335e26-879e-4711-b143-cb1377e41cea tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:36.554011 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9d335e26-879e-4711-b143-cb1377e41cea tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:36.650492 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-cb86669e-3d45-466b-a7fe-8ec24dfed1d0 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:36.651266 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-cb86669e-3d45-466b-a7fe-8ec24dfed1d0 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:36.665220 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cb86669e-3d45-466b-a7fe-8ec24dfed1d0 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:36.667483 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cb86669e-3d45-466b-a7fe-8ec24dfed1d0 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:36.668168 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cb86669e-3d45-466b-a7fe-8ec24dfed1d0 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:36.669114 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cb86669e-3d45-466b-a7fe-8ec24dfed1d0 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:36.671259 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cb86669e-3d45-466b-a7fe-8ec24dfed1d0 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:36.671716 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cb86669e-3d45-466b-a7fe-8ec24dfed1d0 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:36.742655 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-9d335e26-879e-4711-b143-cb1377e41cea tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:36.752582 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-9d335e26-879e-4711-b143-cb1377e41cea tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:36.754090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-9d335e26-879e-4711-b143-cb1377e41cea tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:36.768332 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-9d335e26-879e-4711-b143-cb1377e41cea tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1740 microversion: 2.20 time: 0.235157 Aug 12 11:52:36.769190 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 227/454] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:36 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1740 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:36.954256 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-cb86669e-3d45-466b-a7fe-8ec24dfed1d0 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:36.964475 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-cb86669e-3d45-466b-a7fe-8ec24dfed1d0 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1358 microversion: 2.1 time: 0.319366 Aug 12 11:52:36.965404 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 228/455] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:36 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1358 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:37.715921 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-5dd072db-3e60-4e08-9652-34d1d093dc65 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-799227696", "imageRef": "2887ca5b-6aa2-4cc4-a2be-9322a733fc6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8772582a-00cc-4f16-a2d6-b0e982a114ff"}], "security_groups": [{"name": "tempest-securitygroup--641240988"}], "key_name": "tempest-keypair-1657146943", "user_data": "}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:52:37.798050 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-98c2d665-6f09-487f-a59a-5c028e731ba4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:37.799003 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-98c2d665-6f09-487f-a59a-5c028e731ba4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:37.810417 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-98c2d665-6f09-487f-a59a-5c028e731ba4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:37.811645 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-98c2d665-6f09-487f-a59a-5c028e731ba4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:37.812689 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-98c2d665-6f09-487f-a59a-5c028e731ba4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:37.813896 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-98c2d665-6f09-487f-a59a-5c028e731ba4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:37.814574 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-98c2d665-6f09-487f-a59a-5c028e731ba4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:37.815245 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-98c2d665-6f09-487f-a59a-5c028e731ba4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:37.844770 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.network.neutron [None req-5dd072db-3e60-4e08-9652-34d1d093dc65 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] validate_networks() for [('8772582a-00cc-4f16-a2d6-b0e982a114ff', None, None, None, None, None)] {{(pid=132282) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 11:52:38.071079 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-98c2d665-6f09-487f-a59a-5c028e731ba4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:38.079572 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-98c2d665-6f09-487f-a59a-5c028e731ba4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:38.087792 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-98c2d665-6f09-487f-a59a-5c028e731ba4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:38.089612 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-98c2d665-6f09-487f-a59a-5c028e731ba4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1740 microversion: 2.20 time: 0.297636 Aug 12 11:52:38.090300 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 229/456] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:37 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1740 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:38.099515 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-ed5c21b6-6dba-43dc-8162-a344534ba4c3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:38.100335 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-ed5c21b6-6dba-43dc-8162-a344534ba4c3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:38.108947 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ed5c21b6-6dba-43dc-8162-a344534ba4c3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:38.109749 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ed5c21b6-6dba-43dc-8162-a344534ba4c3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:38.110973 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ed5c21b6-6dba-43dc-8162-a344534ba4c3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:38.112060 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ed5c21b6-6dba-43dc-8162-a344534ba4c3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:38.112798 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ed5c21b6-6dba-43dc-8162-a344534ba4c3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:38.113417 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ed5c21b6-6dba-43dc-8162-a344534ba4c3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:38.381635 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-ed5c21b6-6dba-43dc-8162-a344534ba4c3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:38.390495 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-ed5c21b6-6dba-43dc-8162-a344534ba4c3 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1358 microversion: 2.1 time: 0.298979 Aug 12 11:52:38.392325 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 230/457] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:38 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1358 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:38.435125 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-5dd072db-3e60-4e08-9652-34d1d093dc65 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Flavor limits 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 11:52:38.436105 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-5dd072db-3e60-4e08-9652-34d1d093dc65 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Image limits 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 11:52:38.436956 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-5dd072db-3e60-4e08-9652-34d1d093dc65 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Flavor pref 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 11:52:38.437473 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-5dd072db-3e60-4e08-9652-34d1d093dc65 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Image pref 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 11:52:38.438106 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-5dd072db-3e60-4e08-9652-34d1d093dc65 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 11:52:38.448236 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5dd072db-3e60-4e08-9652-34d1d093dc65 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:38.448813 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5dd072db-3e60-4e08-9652-34d1d093dc65 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:38.449328 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5dd072db-3e60-4e08-9652-34d1d093dc65 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:38.450133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5dd072db-3e60-4e08-9652-34d1d093dc65 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:38.450958 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5dd072db-3e60-4e08-9652-34d1d093dc65 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:38.451466 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5dd072db-3e60-4e08-9652-34d1d093dc65 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:38.469205 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-5dd072db-3e60-4e08-9652-34d1d093dc65 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Getting quotas for project a7e2fce9e9db463aa70188453f20d110. Resources: {'instances', 'ram', 'cores'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:52:38.473710 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-5dd072db-3e60-4e08-9652-34d1d093dc65 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Getting quotas for user 64ec7445644e478ca961be80f84f9863 and project a7e2fce9e9db463aa70188453f20d110. Resources: {'instances', 'ram', 'cores'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:52:38.485817 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-5dd072db-3e60-4e08-9652-34d1d093dc65 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Going to run 1 instances... {{(pid=132282) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 11:52:38.488213 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-5dd072db-3e60-4e08-9652-34d1d093dc65 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2887ca5b-6aa2-4cc4-a2be-9322a733fc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132282) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 11:52:38.535667 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-5dd072db-3e60-4e08-9652-34d1d093dc65 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.824821 Aug 12 11:52:38.536837 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 228/458] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Aug 12 11:52:37 2022] POST /compute/v2.1/servers => generated 408 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 11:52:38.548166 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-34fdeb17-5960-4acc-86df-9f0c79d49011 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:38.549004 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-34fdeb17-5960-4acc-86df-9f0c79d49011 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:38.617982 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-34fdeb17-5960-4acc-86df-9f0c79d49011 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:38.625924 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-34fdeb17-5960-4acc-86df-9f0c79d49011 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1245 microversion: 2.1 time: 0.081852 Aug 12 11:52:38.626497 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 231/459] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:38 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:39.113591 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-39723c65-9a3c-4bc4-b01b-5cee69886adf tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:39.115678 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-39723c65-9a3c-4bc4-b01b-5cee69886adf tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:39.127027 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-39723c65-9a3c-4bc4-b01b-5cee69886adf tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:39.127954 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-39723c65-9a3c-4bc4-b01b-5cee69886adf tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:39.128604 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-39723c65-9a3c-4bc4-b01b-5cee69886adf tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:39.129512 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-39723c65-9a3c-4bc4-b01b-5cee69886adf tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:39.130214 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-39723c65-9a3c-4bc4-b01b-5cee69886adf tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:39.130848 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-39723c65-9a3c-4bc4-b01b-5cee69886adf tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:39.308500 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-39723c65-9a3c-4bc4-b01b-5cee69886adf tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:39.317156 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-39723c65-9a3c-4bc4-b01b-5cee69886adf tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:39.318681 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-39723c65-9a3c-4bc4-b01b-5cee69886adf tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:39.319843 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-39723c65-9a3c-4bc4-b01b-5cee69886adf tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1740 microversion: 2.20 time: 0.210470 Aug 12 11:52:39.335630 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 229/460] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:39 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1740 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:39.418247 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-d10e7228-b0ca-49ad-968a-a9ff054979b4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:39.419507 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-d10e7228-b0ca-49ad-968a-a9ff054979b4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:39.425844 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d10e7228-b0ca-49ad-968a-a9ff054979b4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:39.426337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d10e7228-b0ca-49ad-968a-a9ff054979b4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:39.426818 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d10e7228-b0ca-49ad-968a-a9ff054979b4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:39.427518 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d10e7228-b0ca-49ad-968a-a9ff054979b4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:39.427963 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d10e7228-b0ca-49ad-968a-a9ff054979b4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:39.428569 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d10e7228-b0ca-49ad-968a-a9ff054979b4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:39.564402 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-d10e7228-b0ca-49ad-968a-a9ff054979b4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:39.572106 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-d10e7228-b0ca-49ad-968a-a9ff054979b4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1547 microversion: 2.1 time: 0.160022 Aug 12 11:52:39.580471 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 232/461] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:39 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1547 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:39.592534 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-ffe60cf6-ba8e-46ff-96b0-c0eb17acb464 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:39.593146 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-ffe60cf6-ba8e-46ff-96b0-c0eb17acb464 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:39.599078 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ffe60cf6-ba8e-46ff-96b0-c0eb17acb464 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:39.599635 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ffe60cf6-ba8e-46ff-96b0-c0eb17acb464 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:39.600074 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ffe60cf6-ba8e-46ff-96b0-c0eb17acb464 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:39.600760 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ffe60cf6-ba8e-46ff-96b0-c0eb17acb464 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:39.601213 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ffe60cf6-ba8e-46ff-96b0-c0eb17acb464 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:39.601634 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ffe60cf6-ba8e-46ff-96b0-c0eb17acb464 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:39.647611 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-c9360779-3c2f-45cd-9748-c325f68ec891 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:39.648394 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-c9360779-3c2f-45cd-9748-c325f68ec891 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:39.650766 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_api:SELECT=100 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:39.656008 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c9360779-3c2f-45cd-9748-c325f68ec891 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:39.656610 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c9360779-3c2f-45cd-9748-c325f68ec891 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:39.657190 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c9360779-3c2f-45cd-9748-c325f68ec891 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:39.657976 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c9360779-3c2f-45cd-9748-c325f68ec891 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:39.658524 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c9360779-3c2f-45cd-9748-c325f68ec891 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:39.659066 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c9360779-3c2f-45cd-9748-c325f68ec891 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:39.751645 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-c9360779-3c2f-45cd-9748-c325f68ec891 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:39.761708 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-c9360779-3c2f-45cd-9748-c325f68ec891 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1297 microversion: 2.1 time: 0.118226 Aug 12 11:52:39.762869 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 233/462] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:39 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1297 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:39.795970 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-ffe60cf6-ba8e-46ff-96b0-c0eb17acb464 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:39.805131 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-ffe60cf6-ba8e-46ff-96b0-c0eb17acb464 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1547 microversion: 2.1 time: 0.216292 Aug 12 11:52:39.806128 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 230/463] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:39 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1547 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:39.829591 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-abb8cc4c-a0b6-4e75-8a01-e0c679a17e18 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:39.835195 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-abb8cc4c-a0b6-4e75-8a01-e0c679a17e18 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:39.836179 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-abb8cc4c-a0b6-4e75-8a01-e0c679a17e18 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Searching by: {'deleted': False, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490'} {{(pid=132281) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 12 11:52:39.844154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-abb8cc4c-a0b6-4e75-8a01-e0c679a17e18 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:39.844626 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-abb8cc4c-a0b6-4e75-8a01-e0c679a17e18 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:39.845049 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-abb8cc4c-a0b6-4e75-8a01-e0c679a17e18 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:39.845783 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-abb8cc4c-a0b6-4e75-8a01-e0c679a17e18 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:39.846227 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-abb8cc4c-a0b6-4e75-8a01-e0c679a17e18 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:39.846864 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-abb8cc4c-a0b6-4e75-8a01-e0c679a17e18 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:39.948579 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.multi_cell_list [None req-abb8cc4c-a0b6-4e75-8a01-e0c679a17e18 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132281) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 12 11:52:40.045236 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-abb8cc4c-a0b6-4e75-8a01-e0c679a17e18 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.221677 Aug 12 11:52:40.045922 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 234/464] 10.222.0.42 () {58 vars in 1125 bytes} [Fri Aug 12 11:52:39 2022] GET /compute/v2.1/servers => generated 343 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:52:40.056967 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-cc8f3a76-fa22-4c72-84e7-7bd66d46e596 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:40.058081 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-cc8f3a76-fa22-4c72-84e7-7bd66d46e596 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:40.064986 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cc8f3a76-fa22-4c72-84e7-7bd66d46e596 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:40.065475 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cc8f3a76-fa22-4c72-84e7-7bd66d46e596 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:40.065904 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cc8f3a76-fa22-4c72-84e7-7bd66d46e596 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:40.066593 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cc8f3a76-fa22-4c72-84e7-7bd66d46e596 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:40.067069 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cc8f3a76-fa22-4c72-84e7-7bd66d46e596 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:40.067489 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cc8f3a76-fa22-4c72-84e7-7bd66d46e596 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:40.197529 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-cc8f3a76-fa22-4c72-84e7-7bd66d46e596 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:40.205476 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-cc8f3a76-fa22-4c72-84e7-7bd66d46e596 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1547 microversion: 2.1 time: 0.152266 Aug 12 11:52:40.206041 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 231/465] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:40 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:40.342994 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-83390ee1-6976-46e1-9c8a-e32ff2c1fefb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:40.343590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-83390ee1-6976-46e1-9c8a-e32ff2c1fefb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:40.349812 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-83390ee1-6976-46e1-9c8a-e32ff2c1fefb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:40.350400 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-83390ee1-6976-46e1-9c8a-e32ff2c1fefb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:40.350868 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-83390ee1-6976-46e1-9c8a-e32ff2c1fefb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:40.351689 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-83390ee1-6976-46e1-9c8a-e32ff2c1fefb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:40.352171 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-83390ee1-6976-46e1-9c8a-e32ff2c1fefb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:40.352623 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-83390ee1-6976-46e1-9c8a-e32ff2c1fefb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:40.587133 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-83390ee1-6976-46e1-9c8a-e32ff2c1fefb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:40.595578 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-83390ee1-6976-46e1-9c8a-e32ff2c1fefb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:40.597670 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-83390ee1-6976-46e1-9c8a-e32ff2c1fefb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:40.598848 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-83390ee1-6976-46e1-9c8a-e32ff2c1fefb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1740 microversion: 2.20 time: 0.259655 Aug 12 11:52:40.599708 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 235/466] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:40 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1740 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:40.783348 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-5d26a7ff-11f5-4e10-a285-d5293e88a1f5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:40.784011 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-5d26a7ff-11f5-4e10-a285-d5293e88a1f5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:40.790185 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5d26a7ff-11f5-4e10-a285-d5293e88a1f5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:40.790772 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5d26a7ff-11f5-4e10-a285-d5293e88a1f5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:40.791313 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5d26a7ff-11f5-4e10-a285-d5293e88a1f5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:40.792554 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5d26a7ff-11f5-4e10-a285-d5293e88a1f5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:40.793010 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5d26a7ff-11f5-4e10-a285-d5293e88a1f5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:40.793424 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5d26a7ff-11f5-4e10-a285-d5293e88a1f5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:40.886753 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-5d26a7ff-11f5-4e10-a285-d5293e88a1f5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:40.894154 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-5d26a7ff-11f5-4e10-a285-d5293e88a1f5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1303 microversion: 2.1 time: 0.114861 Aug 12 11:52:40.894865 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 232/467] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:40 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1303 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:41.624317 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-a6323d80-be77-4749-a847-39478d9a7df6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:41.625561 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-a6323d80-be77-4749-a847-39478d9a7df6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:41.631921 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a6323d80-be77-4749-a847-39478d9a7df6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:41.632545 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a6323d80-be77-4749-a847-39478d9a7df6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:41.632983 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a6323d80-be77-4749-a847-39478d9a7df6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:41.633659 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a6323d80-be77-4749-a847-39478d9a7df6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:41.634103 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a6323d80-be77-4749-a847-39478d9a7df6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:41.634513 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a6323d80-be77-4749-a847-39478d9a7df6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:41.754231 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-a26dae93-d5a9-4aea-a7f2-e001e56fe160 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a322b6a7-2f9f-4680-89d8-30ba425408dd"}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:52:41.756682 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-a26dae93-d5a9-4aea-a7f2-e001e56fe160 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:41.763623 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a26dae93-d5a9-4aea-a7f2-e001e56fe160 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:41.764111 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a26dae93-d5a9-4aea-a7f2-e001e56fe160 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:41.764543 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a26dae93-d5a9-4aea-a7f2-e001e56fe160 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:41.765240 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a26dae93-d5a9-4aea-a7f2-e001e56fe160 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:41.765690 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a26dae93-d5a9-4aea-a7f2-e001e56fe160 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:41.766113 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a26dae93-d5a9-4aea-a7f2-e001e56fe160 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:42.095973 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-a6323d80-be77-4749-a847-39478d9a7df6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:42.103995 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-a6323d80-be77-4749-a847-39478d9a7df6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:42.106069 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-a6323d80-be77-4749-a847-39478d9a7df6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:42.107339 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-a6323d80-be77-4749-a847-39478d9a7df6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1722 microversion: 2.20 time: 0.486975 Aug 12 11:52:42.107905 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 236/468] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:41 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1722 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:42.127811 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-b684b449-42c0-4950-8f7e-f68fd5a4e58f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:42.128461 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-b684b449-42c0-4950-8f7e-f68fd5a4e58f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:42.134184 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b684b449-42c0-4950-8f7e-f68fd5a4e58f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:42.134685 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b684b449-42c0-4950-8f7e-f68fd5a4e58f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:42.135117 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b684b449-42c0-4950-8f7e-f68fd5a4e58f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:42.135797 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b684b449-42c0-4950-8f7e-f68fd5a4e58f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:42.136241 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b684b449-42c0-4950-8f7e-f68fd5a4e58f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:42.136655 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b684b449-42c0-4950-8f7e-f68fd5a4e58f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:42.358160 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-b684b449-42c0-4950-8f7e-f68fd5a4e58f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:42.365801 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-b684b449-42c0-4950-8f7e-f68fd5a4e58f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1370 microversion: 2.1 time: 0.246315 Aug 12 11:52:42.366377 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 237/469] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:42 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1370 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:42.472155 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-4e87e77f-1684-4afd-8204-a8d238c1d9ed req-1ea50b7e-7093-4c8a-9d73-4017935f37b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7545dc36-2c18-434c-94e4-771977a58319", "tag": "b5a1de41-5667-4746-80f9-9707f4939d87"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:52:42.481307 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-4e87e77f-1684-4afd-8204-a8d238c1d9ed req-1ea50b7e-7093-4c8a-9d73-4017935f37b6 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:42.481802 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-4e87e77f-1684-4afd-8204-a8d238c1d9ed req-1ea50b7e-7093-4c8a-9d73-4017935f37b6 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:42.482219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-4e87e77f-1684-4afd-8204-a8d238c1d9ed req-1ea50b7e-7093-4c8a-9d73-4017935f37b6 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:42.496272 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-4e87e77f-1684-4afd-8204-a8d238c1d9ed req-1ea50b7e-7093-4c8a-9d73-4017935f37b6 service nova] Creating event network-changed:b5a1de41-5667-4746-80f9-9707f4939d87 for instance 7545dc36-2c18-434c-94e4-771977a58319 on hv-cinder-85282 Aug 12 11:52:42.502177 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-4e87e77f-1684-4afd-8204-a8d238c1d9ed req-1ea50b7e-7093-4c8a-9d73-4017935f37b6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033126 Aug 12 11:52:42.502822 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 238/470] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:52:43.132980 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-8fa11994-d1cb-4b99-b81f-3ffcdd1ab889 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:43.133629 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-8fa11994-d1cb-4b99-b81f-3ffcdd1ab889 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:43.140411 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8fa11994-d1cb-4b99-b81f-3ffcdd1ab889 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:43.140895 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8fa11994-d1cb-4b99-b81f-3ffcdd1ab889 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:43.141326 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8fa11994-d1cb-4b99-b81f-3ffcdd1ab889 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:43.142014 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8fa11994-d1cb-4b99-b81f-3ffcdd1ab889 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:43.142465 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8fa11994-d1cb-4b99-b81f-3ffcdd1ab889 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:43.142902 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8fa11994-d1cb-4b99-b81f-3ffcdd1ab889 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:43.303920 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-8fa11994-d1cb-4b99-b81f-3ffcdd1ab889 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:43.312330 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-8fa11994-d1cb-4b99-b81f-3ffcdd1ab889 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:43.313867 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-8fa11994-d1cb-4b99-b81f-3ffcdd1ab889 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:43.315049 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-8fa11994-d1cb-4b99-b81f-3ffcdd1ab889 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1722 microversion: 2.20 time: 0.186352 Aug 12 11:52:43.315604 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 239/471] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:43 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:52:43.387909 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e970ff04-4f60-4a11-8d3e-896d46dc8d08 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:43.388684 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-e970ff04-4f60-4a11-8d3e-896d46dc8d08 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:43.396330 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e970ff04-4f60-4a11-8d3e-896d46dc8d08 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:43.397996 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e970ff04-4f60-4a11-8d3e-896d46dc8d08 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:43.398361 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e970ff04-4f60-4a11-8d3e-896d46dc8d08 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:43.399131 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e970ff04-4f60-4a11-8d3e-896d46dc8d08 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:43.399583 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e970ff04-4f60-4a11-8d3e-896d46dc8d08 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:43.400016 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e970ff04-4f60-4a11-8d3e-896d46dc8d08 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:43.517579 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-a26dae93-d5a9-4aea-a7f2-e001e56fe160 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "POST /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.766912 Aug 12 11:52:43.524146 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 233/472] 10.222.0.42 () {60 vars in 1323 bytes} [Fri Aug 12 11:52:41 2022] POST /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e/os-volume_attachments => generated 194 bytes in 1774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:52:43.658150 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-e970ff04-4f60-4a11-8d3e-896d46dc8d08 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:43.669488 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-e970ff04-4f60-4a11-8d3e-896d46dc8d08 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1370 microversion: 2.1 time: 0.286145 Aug 12 11:52:43.670267 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 240/473] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:43 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1370 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:52:43.744535 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-84dcf576-8ea3-48d6-b7df-81d08876a210 req-75c7ec61-8306-4226-8b67-5e2b43d2f6e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712bb3a1-789a-442f-8d59-a635f0896531", "name": "network-vif-unplugged", "status": "completed", "tag": "0a1aa4d3-f810-4d8a-b28b-30a0d82ce0c9"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:52:43.755978 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-84dcf576-8ea3-48d6-b7df-81d08876a210 req-75c7ec61-8306-4226-8b67-5e2b43d2f6e9 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:43.756452 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-84dcf576-8ea3-48d6-b7df-81d08876a210 req-75c7ec61-8306-4226-8b67-5e2b43d2f6e9 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:43.756873 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-84dcf576-8ea3-48d6-b7df-81d08876a210 req-75c7ec61-8306-4226-8b67-5e2b43d2f6e9 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:43.767715 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-84dcf576-8ea3-48d6-b7df-81d08876a210 req-75c7ec61-8306-4226-8b67-5e2b43d2f6e9 service nova] Creating event network-vif-unplugged:0a1aa4d3-f810-4d8a-b28b-30a0d82ce0c9 for instance 712bb3a1-789a-442f-8d59-a635f0896531 on hv-cinder-85282 Aug 12 11:52:43.772612 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-84dcf576-8ea3-48d6-b7df-81d08876a210 req-75c7ec61-8306-4226-8b67-5e2b43d2f6e9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032422 Aug 12 11:52:43.773204 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 234/474] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:52:44.337309 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-f1e4898e-6e7b-4ee3-b8aa-0f519b1a753f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:44.337919 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-f1e4898e-6e7b-4ee3-b8aa-0f519b1a753f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:44.344423 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f1e4898e-6e7b-4ee3-b8aa-0f519b1a753f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:44.344905 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f1e4898e-6e7b-4ee3-b8aa-0f519b1a753f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:44.345341 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f1e4898e-6e7b-4ee3-b8aa-0f519b1a753f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:44.346031 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f1e4898e-6e7b-4ee3-b8aa-0f519b1a753f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:44.346485 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f1e4898e-6e7b-4ee3-b8aa-0f519b1a753f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:44.346934 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f1e4898e-6e7b-4ee3-b8aa-0f519b1a753f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:44.550871 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-f1e4898e-6e7b-4ee3-b8aa-0f519b1a753f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:44.559509 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-f1e4898e-6e7b-4ee3-b8aa-0f519b1a753f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:44.561108 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-f1e4898e-6e7b-4ee3-b8aa-0f519b1a753f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:44.562317 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-f1e4898e-6e7b-4ee3-b8aa-0f519b1a753f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1665 microversion: 2.20 time: 0.228868 Aug 12 11:52:44.562900 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 241/475] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:44 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1665 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:44.587608 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-0e763f3e-7231-4786-90ce-8fb9570ab99d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4e9ec4e-6bab-488a-abb3-3355b773aceb"}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:52:44.591329 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-0e763f3e-7231-4786-90ce-8fb9570ab99d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:44.598050 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0e763f3e-7231-4786-90ce-8fb9570ab99d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:44.598536 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0e763f3e-7231-4786-90ce-8fb9570ab99d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:44.599190 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0e763f3e-7231-4786-90ce-8fb9570ab99d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:44.599898 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0e763f3e-7231-4786-90ce-8fb9570ab99d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:44.600361 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0e763f3e-7231-4786-90ce-8fb9570ab99d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:44.600784 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0e763f3e-7231-4786-90ce-8fb9570ab99d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:44.691443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-d2c5d045-1a80-4dcc-a11f-ddc63893d1f9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:44.692136 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-d2c5d045-1a80-4dcc-a11f-ddc63893d1f9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:44.698777 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d2c5d045-1a80-4dcc-a11f-ddc63893d1f9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:44.699295 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d2c5d045-1a80-4dcc-a11f-ddc63893d1f9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:44.700279 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d2c5d045-1a80-4dcc-a11f-ddc63893d1f9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:44.701173 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d2c5d045-1a80-4dcc-a11f-ddc63893d1f9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:44.701794 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d2c5d045-1a80-4dcc-a11f-ddc63893d1f9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:44.702261 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d2c5d045-1a80-4dcc-a11f-ddc63893d1f9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:44.844823 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-d2c5d045-1a80-4dcc-a11f-ddc63893d1f9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:44.852626 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-d2c5d045-1a80-4dcc-a11f-ddc63893d1f9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1370 microversion: 2.1 time: 0.165268 Aug 12 11:52:44.853192 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 242/476] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:44 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:52:44.902024 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-0e763f3e-7231-4786-90ce-8fb9570ab99d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "POST /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.320032 Aug 12 11:52:44.902636 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 235/477] 10.222.0.42 () {62 vars in 1364 bytes} [Fri Aug 12 11:52:44 2022] POST /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531/os-volume_attachments => generated 188 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 11:52:45.020016 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-09f52a1d-e3db-4381-941f-a6ae38befb2e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:52:45.020605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-09f52a1d-e3db-4381-941f-a6ae38befb2e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:45.026921 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-09f52a1d-e3db-4381-941f-a6ae38befb2e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:45.027400 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-09f52a1d-e3db-4381-941f-a6ae38befb2e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:45.027827 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-09f52a1d-e3db-4381-941f-a6ae38befb2e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:45.028505 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-09f52a1d-e3db-4381-941f-a6ae38befb2e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:45.028955 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-09f52a1d-e3db-4381-941f-a6ae38befb2e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:45.029374 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-09f52a1d-e3db-4381-941f-a6ae38befb2e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:45.033054 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=100 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:45.071286 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-09f52a1d-e3db-4381-941f-a6ae38befb2e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132281) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 12 11:52:45.136468 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-09f52a1d-e3db-4381-941f-a6ae38befb2e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "POST /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531/action" status: 202 len: 0 microversion: 2.20 time: 0.120210 Aug 12 11:52:45.137726 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 243/478] 10.222.0.42 () {62 vars in 1319 bytes} [Fri Aug 12 11:52:45 2022] POST /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 12 11:52:45.145592 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-975c6d95-7649-4baf-a72d-e972ab2477a8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:45.146208 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-975c6d95-7649-4baf-a72d-e972ab2477a8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:45.153647 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-975c6d95-7649-4baf-a72d-e972ab2477a8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:45.154131 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-975c6d95-7649-4baf-a72d-e972ab2477a8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:45.154566 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-975c6d95-7649-4baf-a72d-e972ab2477a8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:45.155748 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-975c6d95-7649-4baf-a72d-e972ab2477a8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:45.156364 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-975c6d95-7649-4baf-a72d-e972ab2477a8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:45.156803 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-975c6d95-7649-4baf-a72d-e972ab2477a8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:45.293130 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-975c6d95-7649-4baf-a72d-e972ab2477a8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:45.302439 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-975c6d95-7649-4baf-a72d-e972ab2477a8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:45.304012 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-975c6d95-7649-4baf-a72d-e972ab2477a8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:45.305365 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-975c6d95-7649-4baf-a72d-e972ab2477a8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1751 microversion: 2.20 time: 0.164150 Aug 12 11:52:45.311000 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 236/479] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:45 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:45.876529 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-364b531b-748b-45e9-af17-1b8621126fcf tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:45.877572 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-364b531b-748b-45e9-af17-1b8621126fcf tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:45.885071 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-364b531b-748b-45e9-af17-1b8621126fcf tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:45.886127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-364b531b-748b-45e9-af17-1b8621126fcf tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:45.887591 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-364b531b-748b-45e9-af17-1b8621126fcf tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:45.888296 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-364b531b-748b-45e9-af17-1b8621126fcf tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:45.888750 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-364b531b-748b-45e9-af17-1b8621126fcf tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:45.889232 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-364b531b-748b-45e9-af17-1b8621126fcf tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:46.024227 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-364b531b-748b-45e9-af17-1b8621126fcf tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:46.032747 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-364b531b-748b-45e9-af17-1b8621126fcf tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1370 microversion: 2.1 time: 0.163001 Aug 12 11:52:46.034122 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 244/480] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:45 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:46.327732 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-a73dcd34-0157-499e-8359-430c192157c9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:46.329264 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-a73dcd34-0157-499e-8359-430c192157c9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:46.335943 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a73dcd34-0157-499e-8359-430c192157c9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:46.336503 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a73dcd34-0157-499e-8359-430c192157c9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:46.337069 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a73dcd34-0157-499e-8359-430c192157c9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:46.337844 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a73dcd34-0157-499e-8359-430c192157c9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:46.338419 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a73dcd34-0157-499e-8359-430c192157c9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:46.339062 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a73dcd34-0157-499e-8359-430c192157c9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:46.506342 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-a73dcd34-0157-499e-8359-430c192157c9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:46.515095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-a73dcd34-0157-499e-8359-430c192157c9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:46.516433 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-a73dcd34-0157-499e-8359-430c192157c9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:46.517632 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-a73dcd34-0157-499e-8359-430c192157c9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1753 microversion: 2.20 time: 0.193772 Aug 12 11:52:46.518360 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 237/481] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:46 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1753 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:47.053856 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-12212882-63ac-4476-a9b3-615ed0388202 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:47.054454 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-12212882-63ac-4476-a9b3-615ed0388202 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:47.061027 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-12212882-63ac-4476-a9b3-615ed0388202 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:47.061527 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-12212882-63ac-4476-a9b3-615ed0388202 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:47.061927 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-12212882-63ac-4476-a9b3-615ed0388202 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:47.062618 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-12212882-63ac-4476-a9b3-615ed0388202 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:47.063068 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-12212882-63ac-4476-a9b3-615ed0388202 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:47.063485 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-12212882-63ac-4476-a9b3-615ed0388202 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:47.191298 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-12212882-63ac-4476-a9b3-615ed0388202 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:47.199285 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-12212882-63ac-4476-a9b3-615ed0388202 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1370 microversion: 2.1 time: 0.149149 Aug 12 11:52:47.200363 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 245/482] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:47 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:47.540880 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-f9f6c8f7-7178-4cfb-a303-288f02a95c91 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:47.541446 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-f9f6c8f7-7178-4cfb-a303-288f02a95c91 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:47.547875 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f9f6c8f7-7178-4cfb-a303-288f02a95c91 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:47.548357 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f9f6c8f7-7178-4cfb-a303-288f02a95c91 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:47.548796 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f9f6c8f7-7178-4cfb-a303-288f02a95c91 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:47.549478 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f9f6c8f7-7178-4cfb-a303-288f02a95c91 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:47.549929 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f9f6c8f7-7178-4cfb-a303-288f02a95c91 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:47.550356 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f9f6c8f7-7178-4cfb-a303-288f02a95c91 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:47.681208 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-f9f6c8f7-7178-4cfb-a303-288f02a95c91 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:47.685827 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:47.692606 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-f9f6c8f7-7178-4cfb-a303-288f02a95c91 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:47.694141 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-f9f6c8f7-7178-4cfb-a303-288f02a95c91 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:47.695336 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-f9f6c8f7-7178-4cfb-a303-288f02a95c91 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1753 microversion: 2.20 time: 0.158416 Aug 12 11:52:47.695886 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 238/483] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:47 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:48.220701 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-f42388f5-64ab-40b7-a42c-44d945fa94fc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:48.221317 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-f42388f5-64ab-40b7-a42c-44d945fa94fc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:48.227972 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f42388f5-64ab-40b7-a42c-44d945fa94fc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:48.228459 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f42388f5-64ab-40b7-a42c-44d945fa94fc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:48.228896 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f42388f5-64ab-40b7-a42c-44d945fa94fc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:48.229596 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f42388f5-64ab-40b7-a42c-44d945fa94fc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:48.230048 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f42388f5-64ab-40b7-a42c-44d945fa94fc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:48.230467 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f42388f5-64ab-40b7-a42c-44d945fa94fc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:48.358681 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-f42388f5-64ab-40b7-a42c-44d945fa94fc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:48.366023 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-f42388f5-64ab-40b7-a42c-44d945fa94fc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1370 microversion: 2.1 time: 0.149103 Aug 12 11:52:48.366582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 246/484] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:48 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:48.719665 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e0b61e66-cb1f-4cad-91aa-2a040e5ec062 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:48.720264 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-e0b61e66-cb1f-4cad-91aa-2a040e5ec062 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:48.722091 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=2 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:48.722778 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=10 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:48.729919 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e0b61e66-cb1f-4cad-91aa-2a040e5ec062 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:48.730402 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e0b61e66-cb1f-4cad-91aa-2a040e5ec062 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:48.730869 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e0b61e66-cb1f-4cad-91aa-2a040e5ec062 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:48.731561 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e0b61e66-cb1f-4cad-91aa-2a040e5ec062 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:48.732011 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e0b61e66-cb1f-4cad-91aa-2a040e5ec062 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:48.732433 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e0b61e66-cb1f-4cad-91aa-2a040e5ec062 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:48.878874 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e0b61e66-cb1f-4cad-91aa-2a040e5ec062 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:48.887756 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e0b61e66-cb1f-4cad-91aa-2a040e5ec062 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:48.889239 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e0b61e66-cb1f-4cad-91aa-2a040e5ec062 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:48.890372 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e0b61e66-cb1f-4cad-91aa-2a040e5ec062 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1753 microversion: 2.20 time: 0.175865 Aug 12 11:52:48.890936 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 239/485] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:48 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:49.386584 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-39b3c087-5b4d-4906-82db-2440d5145d82 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:49.387786 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-39b3c087-5b4d-4906-82db-2440d5145d82 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:49.389604 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell0:SELECT=2 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:49.395331 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-39b3c087-5b4d-4906-82db-2440d5145d82 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:49.395810 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-39b3c087-5b4d-4906-82db-2440d5145d82 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:49.396243 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-39b3c087-5b4d-4906-82db-2440d5145d82 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:49.396924 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-39b3c087-5b4d-4906-82db-2440d5145d82 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:49.397374 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-39b3c087-5b4d-4906-82db-2440d5145d82 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:49.397795 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-39b3c087-5b4d-4906-82db-2440d5145d82 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:49.521880 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-39b3c087-5b4d-4906-82db-2440d5145d82 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:49.529171 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-39b3c087-5b4d-4906-82db-2440d5145d82 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1370 microversion: 2.1 time: 0.146413 Aug 12 11:52:49.529731 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 247/486] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:49 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:49.836350 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-46e67af9-9008-4ae7-af85-b445c1f410f3 req-cb75e1c9-6595-434b-9807-2f70ca86bae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7545dc36-2c18-434c-94e4-771977a58319", "name": "network-vif-plugged", "status": "completed", "tag": "b5a1de41-5667-4746-80f9-9707f4939d87"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:52:49.848657 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-46e67af9-9008-4ae7-af85-b445c1f410f3 req-cb75e1c9-6595-434b-9807-2f70ca86bae6 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:49.849364 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-46e67af9-9008-4ae7-af85-b445c1f410f3 req-cb75e1c9-6595-434b-9807-2f70ca86bae6 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:49.849837 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-46e67af9-9008-4ae7-af85-b445c1f410f3 req-cb75e1c9-6595-434b-9807-2f70ca86bae6 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:49.864566 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-46e67af9-9008-4ae7-af85-b445c1f410f3 req-cb75e1c9-6595-434b-9807-2f70ca86bae6 service nova] Creating event network-vif-plugged:b5a1de41-5667-4746-80f9-9707f4939d87 for instance 7545dc36-2c18-434c-94e4-771977a58319 on hv-cinder-85282 Aug 12 11:52:49.869877 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-46e67af9-9008-4ae7-af85-b445c1f410f3 req-cb75e1c9-6595-434b-9807-2f70ca86bae6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037617 Aug 12 11:52:49.871047 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 240/487] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:52:49.913282 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-576e18dd-363d-4951-bc4a-0cb0650f76d3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:49.913906 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-576e18dd-363d-4951-bc4a-0cb0650f76d3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:49.915763 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell0:SELECT=2 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:49.922089 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-576e18dd-363d-4951-bc4a-0cb0650f76d3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:49.922760 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-576e18dd-363d-4951-bc4a-0cb0650f76d3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:49.923191 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-576e18dd-363d-4951-bc4a-0cb0650f76d3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:49.923870 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-576e18dd-363d-4951-bc4a-0cb0650f76d3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:49.924312 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-576e18dd-363d-4951-bc4a-0cb0650f76d3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:49.924726 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-576e18dd-363d-4951-bc4a-0cb0650f76d3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:50.060742 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-576e18dd-363d-4951-bc4a-0cb0650f76d3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:50.070024 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-576e18dd-363d-4951-bc4a-0cb0650f76d3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:50.072563 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-576e18dd-363d-4951-bc4a-0cb0650f76d3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:50.075336 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-576e18dd-363d-4951-bc4a-0cb0650f76d3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1753 microversion: 2.20 time: 0.165008 Aug 12 11:52:50.076368 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 248/488] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:49 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:50.551095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-72a7e3a7-1de9-4fa9-9511-3433079dc7b2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:50.551785 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-72a7e3a7-1de9-4fa9-9511-3433079dc7b2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:50.558158 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-72a7e3a7-1de9-4fa9-9511-3433079dc7b2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:50.558656 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-72a7e3a7-1de9-4fa9-9511-3433079dc7b2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:50.559713 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-72a7e3a7-1de9-4fa9-9511-3433079dc7b2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:50.560387 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-72a7e3a7-1de9-4fa9-9511-3433079dc7b2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:50.560833 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-72a7e3a7-1de9-4fa9-9511-3433079dc7b2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:50.561250 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-72a7e3a7-1de9-4fa9-9511-3433079dc7b2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:50.689004 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-72a7e3a7-1de9-4fa9-9511-3433079dc7b2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:50.696225 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-72a7e3a7-1de9-4fa9-9511-3433079dc7b2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1370 microversion: 2.1 time: 0.149546 Aug 12 11:52:50.696780 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 241/489] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:50 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:51.097875 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-4241d60f-8567-459a-a37a-84e501de9746 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:51.098485 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-4241d60f-8567-459a-a37a-84e501de9746 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:51.104892 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4241d60f-8567-459a-a37a-84e501de9746 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:51.105374 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4241d60f-8567-459a-a37a-84e501de9746 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:51.105813 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4241d60f-8567-459a-a37a-84e501de9746 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:51.106489 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4241d60f-8567-459a-a37a-84e501de9746 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:51.106981 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4241d60f-8567-459a-a37a-84e501de9746 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:51.107400 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4241d60f-8567-459a-a37a-84e501de9746 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:51.235453 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-4241d60f-8567-459a-a37a-84e501de9746 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:51.243894 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-4241d60f-8567-459a-a37a-84e501de9746 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:51.245474 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-4241d60f-8567-459a-a37a-84e501de9746 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:51.246723 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-4241d60f-8567-459a-a37a-84e501de9746 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1753 microversion: 2.20 time: 0.153137 Aug 12 11:52:51.247308 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 249/490] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:51 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:51.716782 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-351c082f-0a25-4daf-99fe-25237fe439fc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:51.717401 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-351c082f-0a25-4daf-99fe-25237fe439fc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:51.723997 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-351c082f-0a25-4daf-99fe-25237fe439fc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:51.724471 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-351c082f-0a25-4daf-99fe-25237fe439fc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:51.724931 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-351c082f-0a25-4daf-99fe-25237fe439fc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:51.725610 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-351c082f-0a25-4daf-99fe-25237fe439fc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:51.726056 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-351c082f-0a25-4daf-99fe-25237fe439fc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:51.726476 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-351c082f-0a25-4daf-99fe-25237fe439fc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:51.850385 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-351c082f-0a25-4daf-99fe-25237fe439fc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:51.858093 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-351c082f-0a25-4daf-99fe-25237fe439fc tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1370 microversion: 2.1 time: 0.145129 Aug 12 11:52:51.858656 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 242/491] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:51 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1370 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:52.269257 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-21c6c366-7f57-4b55-9126-54da1c0485fb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:52.269769 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-21c6c366-7f57-4b55-9126-54da1c0485fb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:52.276112 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-21c6c366-7f57-4b55-9126-54da1c0485fb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:52.276591 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-21c6c366-7f57-4b55-9126-54da1c0485fb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:52.277019 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-21c6c366-7f57-4b55-9126-54da1c0485fb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:52.278197 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-21c6c366-7f57-4b55-9126-54da1c0485fb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:52.278672 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-21c6c366-7f57-4b55-9126-54da1c0485fb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:52.279090 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-21c6c366-7f57-4b55-9126-54da1c0485fb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:52.406407 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-21c6c366-7f57-4b55-9126-54da1c0485fb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:52.414749 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-21c6c366-7f57-4b55-9126-54da1c0485fb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:52.416234 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-21c6c366-7f57-4b55-9126-54da1c0485fb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:52.417370 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-21c6c366-7f57-4b55-9126-54da1c0485fb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1753 microversion: 2.20 time: 0.152157 Aug 12 11:52:52.417931 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 250/492] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:52 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:52.878670 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-6d29c6c6-3cc3-4240-8ea4-339c3a7c6fe6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:52.879311 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-6d29c6c6-3cc3-4240-8ea4-339c3a7c6fe6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:52.885649 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6d29c6c6-3cc3-4240-8ea4-339c3a7c6fe6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:52.886124 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6d29c6c6-3cc3-4240-8ea4-339c3a7c6fe6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:52.886556 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6d29c6c6-3cc3-4240-8ea4-339c3a7c6fe6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:52.887911 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6d29c6c6-3cc3-4240-8ea4-339c3a7c6fe6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:52.888362 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6d29c6c6-3cc3-4240-8ea4-339c3a7c6fe6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:52.888780 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6d29c6c6-3cc3-4240-8ea4-339c3a7c6fe6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:53.014135 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-6d29c6c6-3cc3-4240-8ea4-339c3a7c6fe6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:53.021463 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-6d29c6c6-3cc3-4240-8ea4-339c3a7c6fe6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1565 microversion: 2.1 time: 0.146655 Aug 12 11:52:53.022021 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 243/493] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:52 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:53.042795 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-3f189ebc-c30a-44e2-bdd2-d59cbd2d84d5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:53.043384 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-3f189ebc-c30a-44e2-bdd2-d59cbd2d84d5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:53.051301 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3f189ebc-c30a-44e2-bdd2-d59cbd2d84d5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:53.051891 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3f189ebc-c30a-44e2-bdd2-d59cbd2d84d5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:53.052364 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3f189ebc-c30a-44e2-bdd2-d59cbd2d84d5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:53.053147 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3f189ebc-c30a-44e2-bdd2-d59cbd2d84d5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:53.053684 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3f189ebc-c30a-44e2-bdd2-d59cbd2d84d5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:53.054301 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3f189ebc-c30a-44e2-bdd2-d59cbd2d84d5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:53.130511 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-3f189ebc-c30a-44e2-bdd2-d59cbd2d84d5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092343 Aug 12 11:52:53.131144 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 251/494] 10.222.0.42 () {58 vars in 1275 bytes} [Fri Aug 12 11:52:53 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:52:53.441333 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d3bc0c73-c27a-479e-8de2-2bd8ce1e195e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:53.441943 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d3bc0c73-c27a-479e-8de2-2bd8ce1e195e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:53.448068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d3bc0c73-c27a-479e-8de2-2bd8ce1e195e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:53.448784 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d3bc0c73-c27a-479e-8de2-2bd8ce1e195e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:53.449218 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d3bc0c73-c27a-479e-8de2-2bd8ce1e195e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:53.450126 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d3bc0c73-c27a-479e-8de2-2bd8ce1e195e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:53.450581 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d3bc0c73-c27a-479e-8de2-2bd8ce1e195e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:53.451052 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d3bc0c73-c27a-479e-8de2-2bd8ce1e195e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:53.665984 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d3bc0c73-c27a-479e-8de2-2bd8ce1e195e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:53.675160 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d3bc0c73-c27a-479e-8de2-2bd8ce1e195e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:53.676670 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d3bc0c73-c27a-479e-8de2-2bd8ce1e195e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:53.677843 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-d3bc0c73-c27a-479e-8de2-2bd8ce1e195e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1753 microversion: 2.20 time: 0.240450 Aug 12 11:52:53.678403 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 244/495] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:53 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1753 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:54.176541 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-fba9863d-cce4-4d1e-ae5d-d2addcf98986 req-9d11e68d-db5c-4d75-bf4d-df9e6c38e09d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7545dc36-2c18-434c-94e4-771977a58319", "tag": "b5a1de41-5667-4746-80f9-9707f4939d87"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:52:54.188718 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-fba9863d-cce4-4d1e-ae5d-d2addcf98986 req-9d11e68d-db5c-4d75-bf4d-df9e6c38e09d service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:54.189391 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-fba9863d-cce4-4d1e-ae5d-d2addcf98986 req-9d11e68d-db5c-4d75-bf4d-df9e6c38e09d service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:54.189970 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-fba9863d-cce4-4d1e-ae5d-d2addcf98986 req-9d11e68d-db5c-4d75-bf4d-df9e6c38e09d service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:54.212840 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-fba9863d-cce4-4d1e-ae5d-d2addcf98986 req-9d11e68d-db5c-4d75-bf4d-df9e6c38e09d service nova] Creating event network-changed:b5a1de41-5667-4746-80f9-9707f4939d87 for instance 7545dc36-2c18-434c-94e4-771977a58319 on hv-cinder-85282 Aug 12 11:52:54.223236 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-fba9863d-cce4-4d1e-ae5d-d2addcf98986 req-9d11e68d-db5c-4d75-bf4d-df9e6c38e09d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052866 Aug 12 11:52:54.225001 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 252/496] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:52:54.333833 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-74622e0e-d4d0-470b-89f3-5d5bd6e6149e tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:54.334460 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-74622e0e-d4d0-470b-89f3-5d5bd6e6149e tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:54.341856 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-74622e0e-d4d0-470b-89f3-5d5bd6e6149e tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:54.343030 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-74622e0e-d4d0-470b-89f3-5d5bd6e6149e tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:54.343567 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-74622e0e-d4d0-470b-89f3-5d5bd6e6149e tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:54.344362 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-74622e0e-d4d0-470b-89f3-5d5bd6e6149e tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:54.345433 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-74622e0e-d4d0-470b-89f3-5d5bd6e6149e tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:54.345958 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-74622e0e-d4d0-470b-89f3-5d5bd6e6149e tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:54.550807 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-74622e0e-d4d0-470b-89f3-5d5bd6e6149e tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:54.561553 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-74622e0e-d4d0-470b-89f3-5d5bd6e6149e tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1593 microversion: 2.1 time: 0.231742 Aug 12 11:52:54.563059 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 245/497] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:54 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1593 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:54.706835 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-7f46af56-3fda-4b42-9b27-1cca6842991d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:54.707838 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-7f46af56-3fda-4b42-9b27-1cca6842991d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:54.716613 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7f46af56-3fda-4b42-9b27-1cca6842991d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:54.717733 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7f46af56-3fda-4b42-9b27-1cca6842991d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:54.718329 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7f46af56-3fda-4b42-9b27-1cca6842991d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:54.719236 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7f46af56-3fda-4b42-9b27-1cca6842991d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:54.719845 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7f46af56-3fda-4b42-9b27-1cca6842991d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:54.720670 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7f46af56-3fda-4b42-9b27-1cca6842991d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:55.198910 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-7f46af56-3fda-4b42-9b27-1cca6842991d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:55.210040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-7f46af56-3fda-4b42-9b27-1cca6842991d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:55.211707 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-7f46af56-3fda-4b42-9b27-1cca6842991d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:55.212980 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-7f46af56-3fda-4b42-9b27-1cca6842991d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1809 microversion: 2.20 time: 0.514726 Aug 12 11:52:55.213632 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 253/498] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:54 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1809 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:56.235895 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-8fef8540-b9e4-4973-9214-bc2f9fbdcd0e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:56.236618 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-8fef8540-b9e4-4973-9214-bc2f9fbdcd0e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:56.243129 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8fef8540-b9e4-4973-9214-bc2f9fbdcd0e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:56.243607 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8fef8540-b9e4-4973-9214-bc2f9fbdcd0e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:56.244041 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8fef8540-b9e4-4973-9214-bc2f9fbdcd0e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:56.244726 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8fef8540-b9e4-4973-9214-bc2f9fbdcd0e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:56.245169 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8fef8540-b9e4-4973-9214-bc2f9fbdcd0e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:56.245582 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8fef8540-b9e4-4973-9214-bc2f9fbdcd0e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:56.389309 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-8fef8540-b9e4-4973-9214-bc2f9fbdcd0e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:56.398412 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-8fef8540-b9e4-4973-9214-bc2f9fbdcd0e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:56.399931 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-8fef8540-b9e4-4973-9214-bc2f9fbdcd0e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:56.401084 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-8fef8540-b9e4-4973-9214-bc2f9fbdcd0e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1809 microversion: 2.20 time: 0.169354 Aug 12 11:52:56.401948 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 246/499] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:56 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:56.653053 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-ff39c203-6953-45ff-8815-c0a41c85c5aa req-902f75b8-0b51-4e19-ba48-dc4a32e5252b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e", "tag": "c541547f-b103-4c29-8532-035ca341eb76"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:52:56.663761 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-ff39c203-6953-45ff-8815-c0a41c85c5aa req-902f75b8-0b51-4e19-ba48-dc4a32e5252b service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:56.664229 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-ff39c203-6953-45ff-8815-c0a41c85c5aa req-902f75b8-0b51-4e19-ba48-dc4a32e5252b service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:56.664649 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-ff39c203-6953-45ff-8815-c0a41c85c5aa req-902f75b8-0b51-4e19-ba48-dc4a32e5252b service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:56.677959 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-ff39c203-6953-45ff-8815-c0a41c85c5aa req-902f75b8-0b51-4e19-ba48-dc4a32e5252b service nova] Creating event network-changed:c541547f-b103-4c29-8532-035ca341eb76 for instance 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e on hv-cinder-85282 Aug 12 11:52:56.684367 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-ff39c203-6953-45ff-8815-c0a41c85c5aa req-902f75b8-0b51-4e19-ba48-dc4a32e5252b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034545 Aug 12 11:52:56.688374 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 254/500] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:52:57.431919 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-0c41a7b3-6475-4e93-9a2a-c2fc2aa4c0fd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:57.433705 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-0c41a7b3-6475-4e93-9a2a-c2fc2aa4c0fd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:57.447490 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0c41a7b3-6475-4e93-9a2a-c2fc2aa4c0fd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:57.450105 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0c41a7b3-6475-4e93-9a2a-c2fc2aa4c0fd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:57.451072 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0c41a7b3-6475-4e93-9a2a-c2fc2aa4c0fd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:57.452851 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0c41a7b3-6475-4e93-9a2a-c2fc2aa4c0fd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:57.454473 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0c41a7b3-6475-4e93-9a2a-c2fc2aa4c0fd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:57.457473 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0c41a7b3-6475-4e93-9a2a-c2fc2aa4c0fd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:57.675845 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-0c41a7b3-6475-4e93-9a2a-c2fc2aa4c0fd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:57.689244 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-0c41a7b3-6475-4e93-9a2a-c2fc2aa4c0fd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:57.691277 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-0c41a7b3-6475-4e93-9a2a-c2fc2aa4c0fd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:57.696280 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-0c41a7b3-6475-4e93-9a2a-c2fc2aa4c0fd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1809 microversion: 2.20 time: 0.274052 Aug 12 11:52:57.697210 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 247/501] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:57 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1809 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:57.874187 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-90e6c196-832b-4b43-95d4-105c3875b494 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1935729898"}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:52:57.875455 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-90e6c196-832b-4b43-95d4-105c3875b494 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:57.883258 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-90e6c196-832b-4b43-95d4-105c3875b494 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:57.883881 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-90e6c196-832b-4b43-95d4-105c3875b494 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:57.884549 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-90e6c196-832b-4b43-95d4-105c3875b494 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:57.885448 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-90e6c196-832b-4b43-95d4-105c3875b494 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:57.886076 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-90e6c196-832b-4b43-95d4-105c3875b494 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:57.886947 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-90e6c196-832b-4b43-95d4-105c3875b494 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:58.059385 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.network.security_group_api [None req-90e6c196-832b-4b43-95d4-105c3875b494 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Adding security group a4635465-08b0-4c93-97b9-0ad3b09b4c99 to port c541547f-b103-4c29-8532-035ca341eb76 Aug 12 11:52:58.420330 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-90e6c196-832b-4b43-95d4-105c3875b494 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "POST /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e/action" status: 202 len: 0 microversion: 2.1 time: 0.550990 Aug 12 11:52:58.421639 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 255/502] 10.222.0.42 () {60 vars in 1278 bytes} [Fri Aug 12 11:52:57 2022] POST /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e/action => generated 0 bytes in 554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 12 11:52:58.434649 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-c4007a78-ddfc-4214-973f-25f8470fe268 req-10f4b40d-4399-49a9-aea7-0ba12763130b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e", "tag": "c541547f-b103-4c29-8532-035ca341eb76"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:52:58.435579 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-07046a1b-e1a5-4d8c-b949-b33e4483bba4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:58.436271 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-07046a1b-e1a5-4d8c-b949-b33e4483bba4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:58.438394 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:58.452997 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-07046a1b-e1a5-4d8c-b949-b33e4483bba4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:58.453777 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-07046a1b-e1a5-4d8c-b949-b33e4483bba4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:58.455443 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-07046a1b-e1a5-4d8c-b949-b33e4483bba4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:58.456328 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-07046a1b-e1a5-4d8c-b949-b33e4483bba4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:58.457528 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-c4007a78-ddfc-4214-973f-25f8470fe268 req-10f4b40d-4399-49a9-aea7-0ba12763130b service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:58.458545 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-07046a1b-e1a5-4d8c-b949-b33e4483bba4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:58.459174 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-07046a1b-e1a5-4d8c-b949-b33e4483bba4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:58.460498 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-c4007a78-ddfc-4214-973f-25f8470fe268 req-10f4b40d-4399-49a9-aea7-0ba12763130b service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:58.460813 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-c4007a78-ddfc-4214-973f-25f8470fe268 req-10f4b40d-4399-49a9-aea7-0ba12763130b service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:58.473151 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-c4007a78-ddfc-4214-973f-25f8470fe268 req-10f4b40d-4399-49a9-aea7-0ba12763130b service nova] Creating event network-changed:c541547f-b103-4c29-8532-035ca341eb76 for instance 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e on hv-cinder-85282 Aug 12 11:52:58.482824 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-c4007a78-ddfc-4214-973f-25f8470fe268 req-10f4b40d-4399-49a9-aea7-0ba12763130b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052401 Aug 12 11:52:58.483434 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 256/503] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:52:58.626359 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-07046a1b-e1a5-4d8c-b949-b33e4483bba4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:58.636284 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-07046a1b-e1a5-4d8c-b949-b33e4483bba4 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1640 microversion: 2.1 time: 0.210719 Aug 12 11:52:58.637384 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 248/504] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:52:58 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1640 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:52:58.725668 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-87c7b879-fc80-4085-917c-cdb47abd6034 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:58.726791 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-87c7b879-fc80-4085-917c-cdb47abd6034 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:58.733859 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-87c7b879-fc80-4085-917c-cdb47abd6034 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:58.734853 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-87c7b879-fc80-4085-917c-cdb47abd6034 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:58.735728 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-87c7b879-fc80-4085-917c-cdb47abd6034 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:58.736809 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-87c7b879-fc80-4085-917c-cdb47abd6034 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:58.737537 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-87c7b879-fc80-4085-917c-cdb47abd6034 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:58.738431 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-87c7b879-fc80-4085-917c-cdb47abd6034 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:58.901219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-87c7b879-fc80-4085-917c-cdb47abd6034 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:58.910995 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-87c7b879-fc80-4085-917c-cdb47abd6034 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:58.912994 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-87c7b879-fc80-4085-917c-cdb47abd6034 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:52:58.914489 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-87c7b879-fc80-4085-917c-cdb47abd6034 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1809 microversion: 2.20 time: 0.193796 Aug 12 11:52:58.915294 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 257/505] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:58 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:52:59.937661 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-bc3d4e95-9a09-4658-897a-bbca1b93a32a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:52:59.938270 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-bc3d4e95-9a09-4658-897a-bbca1b93a32a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:52:59.944763 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bc3d4e95-9a09-4658-897a-bbca1b93a32a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:59.945263 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bc3d4e95-9a09-4658-897a-bbca1b93a32a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:59.945689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bc3d4e95-9a09-4658-897a-bbca1b93a32a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:52:59.946365 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bc3d4e95-9a09-4658-897a-bbca1b93a32a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:52:59.946854 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bc3d4e95-9a09-4658-897a-bbca1b93a32a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:52:59.947277 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bc3d4e95-9a09-4658-897a-bbca1b93a32a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:00.085381 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-bc3d4e95-9a09-4658-897a-bbca1b93a32a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:00.094432 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-bc3d4e95-9a09-4658-897a-bbca1b93a32a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:00.096080 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-bc3d4e95-9a09-4658-897a-bbca1b93a32a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:00.097262 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-bc3d4e95-9a09-4658-897a-bbca1b93a32a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1809 microversion: 2.20 time: 0.163599 Aug 12 11:53:00.097804 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 249/506] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:52:59 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:53:01.119591 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-90cbc60b-ddf7-446a-811d-f479c6fae55d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:01.120203 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-90cbc60b-ddf7-446a-811d-f479c6fae55d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:01.127026 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-90cbc60b-ddf7-446a-811d-f479c6fae55d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:01.127556 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-90cbc60b-ddf7-446a-811d-f479c6fae55d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:01.127940 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-90cbc60b-ddf7-446a-811d-f479c6fae55d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:01.128630 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-90cbc60b-ddf7-446a-811d-f479c6fae55d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:01.129080 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-90cbc60b-ddf7-446a-811d-f479c6fae55d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:01.129500 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-90cbc60b-ddf7-446a-811d-f479c6fae55d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:01.258743 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-90cbc60b-ddf7-446a-811d-f479c6fae55d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:01.267988 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-90cbc60b-ddf7-446a-811d-f479c6fae55d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:01.269548 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-90cbc60b-ddf7-446a-811d-f479c6fae55d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:01.270751 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-90cbc60b-ddf7-446a-811d-f479c6fae55d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1809 microversion: 2.20 time: 0.155049 Aug 12 11:53:01.277943 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 258/507] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:53:01 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:53:02.294163 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e3c4c1ad-22c8-4d61-be9d-4b0479bd209e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:02.294899 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-e3c4c1ad-22c8-4d61-be9d-4b0479bd209e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:02.301465 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e3c4c1ad-22c8-4d61-be9d-4b0479bd209e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:02.301941 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e3c4c1ad-22c8-4d61-be9d-4b0479bd209e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:02.302370 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e3c4c1ad-22c8-4d61-be9d-4b0479bd209e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:02.303084 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e3c4c1ad-22c8-4d61-be9d-4b0479bd209e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:02.303529 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e3c4c1ad-22c8-4d61-be9d-4b0479bd209e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:02.303945 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e3c4c1ad-22c8-4d61-be9d-4b0479bd209e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:02.445082 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e3c4c1ad-22c8-4d61-be9d-4b0479bd209e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:02.454170 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e3c4c1ad-22c8-4d61-be9d-4b0479bd209e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:02.456098 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e3c4c1ad-22c8-4d61-be9d-4b0479bd209e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:02.457471 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e3c4c1ad-22c8-4d61-be9d-4b0479bd209e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1809 microversion: 2.20 time: 0.168028 Aug 12 11:53:02.458220 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 250/508] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:53:02 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:53:03.479857 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-bcbeea4e-6903-43cb-b670-c2cf24f46b59 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:03.480480 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-bcbeea4e-6903-43cb-b670-c2cf24f46b59 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:03.486862 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bcbeea4e-6903-43cb-b670-c2cf24f46b59 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:03.487342 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bcbeea4e-6903-43cb-b670-c2cf24f46b59 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:03.487769 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bcbeea4e-6903-43cb-b670-c2cf24f46b59 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:03.488462 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bcbeea4e-6903-43cb-b670-c2cf24f46b59 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:03.488896 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bcbeea4e-6903-43cb-b670-c2cf24f46b59 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:03.489316 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bcbeea4e-6903-43cb-b670-c2cf24f46b59 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:03.641468 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-bcbeea4e-6903-43cb-b670-c2cf24f46b59 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:03.650947 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-bcbeea4e-6903-43cb-b670-c2cf24f46b59 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:03.652484 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-bcbeea4e-6903-43cb-b670-c2cf24f46b59 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:03.653666 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-bcbeea4e-6903-43cb-b670-c2cf24f46b59 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1809 microversion: 2.20 time: 0.177672 Aug 12 11:53:03.654225 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 259/509] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:53:03 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:53:04.675858 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-23523122-4485-41d2-962c-a23f89da50cc tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:04.676531 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-23523122-4485-41d2-962c-a23f89da50cc tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:04.683882 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-23523122-4485-41d2-962c-a23f89da50cc tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:04.684390 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-23523122-4485-41d2-962c-a23f89da50cc tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:04.684982 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-23523122-4485-41d2-962c-a23f89da50cc tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:04.685758 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-23523122-4485-41d2-962c-a23f89da50cc tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:04.686211 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-23523122-4485-41d2-962c-a23f89da50cc tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:04.686673 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-23523122-4485-41d2-962c-a23f89da50cc tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:04.819814 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-23523122-4485-41d2-962c-a23f89da50cc tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:04.835277 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-23523122-4485-41d2-962c-a23f89da50cc tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:04.837213 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-23523122-4485-41d2-962c-a23f89da50cc tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:04.838441 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-23523122-4485-41d2-962c-a23f89da50cc tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1809 microversion: 2.20 time: 0.166484 Aug 12 11:53:04.839182 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 251/510] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:53:04 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:53:05.861155 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-bb9aee34-b319-4f88-a8e7-eb08577eb99d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:05.863344 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-bb9aee34-b319-4f88-a8e7-eb08577eb99d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:05.868613 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bb9aee34-b319-4f88-a8e7-eb08577eb99d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:05.869085 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bb9aee34-b319-4f88-a8e7-eb08577eb99d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:05.869513 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bb9aee34-b319-4f88-a8e7-eb08577eb99d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:05.870196 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bb9aee34-b319-4f88-a8e7-eb08577eb99d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:05.870657 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bb9aee34-b319-4f88-a8e7-eb08577eb99d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:05.871088 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bb9aee34-b319-4f88-a8e7-eb08577eb99d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:06.013385 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-bb9aee34-b319-4f88-a8e7-eb08577eb99d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:06.022457 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-bb9aee34-b319-4f88-a8e7-eb08577eb99d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:06.024198 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-bb9aee34-b319-4f88-a8e7-eb08577eb99d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:06.025376 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-bb9aee34-b319-4f88-a8e7-eb08577eb99d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1809 microversion: 2.20 time: 0.168182 Aug 12 11:53:06.026123 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 260/511] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:53:05 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:53:07.048280 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-581b9c22-2909-4e02-a98a-1a454e617f58 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:07.048851 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-581b9c22-2909-4e02-a98a-1a454e617f58 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:07.055214 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-581b9c22-2909-4e02-a98a-1a454e617f58 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:07.055693 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-581b9c22-2909-4e02-a98a-1a454e617f58 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:07.056127 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-581b9c22-2909-4e02-a98a-1a454e617f58 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:07.056812 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-581b9c22-2909-4e02-a98a-1a454e617f58 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:07.057263 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-581b9c22-2909-4e02-a98a-1a454e617f58 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:07.057689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-581b9c22-2909-4e02-a98a-1a454e617f58 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:07.186863 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-581b9c22-2909-4e02-a98a-1a454e617f58 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:07.195188 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-581b9c22-2909-4e02-a98a-1a454e617f58 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:07.196716 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-581b9c22-2909-4e02-a98a-1a454e617f58 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:07.197859 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-581b9c22-2909-4e02-a98a-1a454e617f58 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1809 microversion: 2.20 time: 0.153576 Aug 12 11:53:07.198407 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 252/512] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:53:07 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:53:08.221468 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-700da4e5-f053-4d1a-b34e-73b9bf0efbf5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:08.222076 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-700da4e5-f053-4d1a-b34e-73b9bf0efbf5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:08.228392 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-700da4e5-f053-4d1a-b34e-73b9bf0efbf5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:08.228878 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-700da4e5-f053-4d1a-b34e-73b9bf0efbf5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:08.229314 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-700da4e5-f053-4d1a-b34e-73b9bf0efbf5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:08.230009 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-700da4e5-f053-4d1a-b34e-73b9bf0efbf5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:08.230460 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-700da4e5-f053-4d1a-b34e-73b9bf0efbf5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:08.230911 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-700da4e5-f053-4d1a-b34e-73b9bf0efbf5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:08.249806 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:53:08.414135 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-700da4e5-f053-4d1a-b34e-73b9bf0efbf5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:08.423017 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-700da4e5-f053-4d1a-b34e-73b9bf0efbf5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:08.424510 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-700da4e5-f053-4d1a-b34e-73b9bf0efbf5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:08.425658 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-700da4e5-f053-4d1a-b34e-73b9bf0efbf5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1809 microversion: 2.20 time: 0.208055 Aug 12 11:53:08.426212 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 261/513] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:53:08 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1809 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:53:09.448343 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-66b96bb7-b945-4f1e-92c2-6116753448c2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:09.448888 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-66b96bb7-b945-4f1e-92c2-6116753448c2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:09.455863 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-66b96bb7-b945-4f1e-92c2-6116753448c2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:09.456343 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-66b96bb7-b945-4f1e-92c2-6116753448c2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:09.456769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-66b96bb7-b945-4f1e-92c2-6116753448c2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:09.457443 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-66b96bb7-b945-4f1e-92c2-6116753448c2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:09.457885 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-66b96bb7-b945-4f1e-92c2-6116753448c2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:09.458301 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-66b96bb7-b945-4f1e-92c2-6116753448c2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:09.584215 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-66b96bb7-b945-4f1e-92c2-6116753448c2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:09.592333 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-66b96bb7-b945-4f1e-92c2-6116753448c2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:09.593804 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-66b96bb7-b945-4f1e-92c2-6116753448c2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:09.594960 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-66b96bb7-b945-4f1e-92c2-6116753448c2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1809 microversion: 2.20 time: 0.150529 Aug 12 11:53:09.595507 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 253/514] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:53:09 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:53:10.617748 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-46239541-34e8-41cf-98fd-11bd129a329d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:10.618363 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-46239541-34e8-41cf-98fd-11bd129a329d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:10.620637 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:53:10.626417 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-46239541-34e8-41cf-98fd-11bd129a329d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:10.626945 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-46239541-34e8-41cf-98fd-11bd129a329d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:10.627370 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-46239541-34e8-41cf-98fd-11bd129a329d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:10.628041 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-46239541-34e8-41cf-98fd-11bd129a329d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:10.628480 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-46239541-34e8-41cf-98fd-11bd129a329d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:10.628889 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-46239541-34e8-41cf-98fd-11bd129a329d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:10.756042 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-46239541-34e8-41cf-98fd-11bd129a329d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:10.765230 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-46239541-34e8-41cf-98fd-11bd129a329d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:10.766735 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-46239541-34e8-41cf-98fd-11bd129a329d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:10.767879 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-46239541-34e8-41cf-98fd-11bd129a329d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1809 microversion: 2.20 time: 0.153965 Aug 12 11:53:10.768627 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 262/515] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:53:10 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:53:11.791161 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-57199435-1c25-43be-9f51-a1e826fa6dc6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:11.791796 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-57199435-1c25-43be-9f51-a1e826fa6dc6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:11.798241 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-57199435-1c25-43be-9f51-a1e826fa6dc6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:11.798748 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-57199435-1c25-43be-9f51-a1e826fa6dc6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:11.799182 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-57199435-1c25-43be-9f51-a1e826fa6dc6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:11.799862 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-57199435-1c25-43be-9f51-a1e826fa6dc6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:11.800311 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-57199435-1c25-43be-9f51-a1e826fa6dc6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:11.800731 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-57199435-1c25-43be-9f51-a1e826fa6dc6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:11.931112 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-57199435-1c25-43be-9f51-a1e826fa6dc6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:11.940760 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-57199435-1c25-43be-9f51-a1e826fa6dc6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:11.942245 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-57199435-1c25-43be-9f51-a1e826fa6dc6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:11.943432 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-57199435-1c25-43be-9f51-a1e826fa6dc6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1809 microversion: 2.20 time: 0.156121 Aug 12 11:53:11.943983 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 254/516] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:53:11 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:53:12.967655 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-fc53943a-8222-4076-ac78-2f28936cd7b4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:12.968249 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-fc53943a-8222-4076-ac78-2f28936cd7b4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:12.974254 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fc53943a-8222-4076-ac78-2f28936cd7b4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:12.974777 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fc53943a-8222-4076-ac78-2f28936cd7b4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:12.975205 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fc53943a-8222-4076-ac78-2f28936cd7b4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:12.975897 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fc53943a-8222-4076-ac78-2f28936cd7b4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:12.976343 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fc53943a-8222-4076-ac78-2f28936cd7b4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:12.976761 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fc53943a-8222-4076-ac78-2f28936cd7b4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:13.106312 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-fc53943a-8222-4076-ac78-2f28936cd7b4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:13.114709 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-fc53943a-8222-4076-ac78-2f28936cd7b4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:13.116202 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-fc53943a-8222-4076-ac78-2f28936cd7b4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:13.117342 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-fc53943a-8222-4076-ac78-2f28936cd7b4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1809 microversion: 2.20 time: 0.154867 Aug 12 11:53:13.117904 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 263/517] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:53:12 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:53:14.140423 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-c71e98f0-cb57-47dc-b6a0-e2f0b347ff40 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:14.140950 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-c71e98f0-cb57-47dc-b6a0-e2f0b347ff40 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:14.147350 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c71e98f0-cb57-47dc-b6a0-e2f0b347ff40 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:14.147831 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c71e98f0-cb57-47dc-b6a0-e2f0b347ff40 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:14.148266 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c71e98f0-cb57-47dc-b6a0-e2f0b347ff40 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:14.148945 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c71e98f0-cb57-47dc-b6a0-e2f0b347ff40 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:14.149397 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c71e98f0-cb57-47dc-b6a0-e2f0b347ff40 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:14.149820 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c71e98f0-cb57-47dc-b6a0-e2f0b347ff40 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:14.276625 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-c71e98f0-cb57-47dc-b6a0-e2f0b347ff40 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:14.285437 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-c71e98f0-cb57-47dc-b6a0-e2f0b347ff40 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:14.286951 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-c71e98f0-cb57-47dc-b6a0-e2f0b347ff40 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:14.288098 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-c71e98f0-cb57-47dc-b6a0-e2f0b347ff40 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1809 microversion: 2.20 time: 0.151607 Aug 12 11:53:14.288644 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 255/518] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:53:14 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:53:15.311188 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-18384dda-b10b-4611-91fa-ca286fcc85d0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:15.311791 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-18384dda-b10b-4611-91fa-ca286fcc85d0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:15.318195 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-18384dda-b10b-4611-91fa-ca286fcc85d0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:15.318694 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-18384dda-b10b-4611-91fa-ca286fcc85d0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:15.319121 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-18384dda-b10b-4611-91fa-ca286fcc85d0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:15.319792 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-18384dda-b10b-4611-91fa-ca286fcc85d0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:15.320233 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-18384dda-b10b-4611-91fa-ca286fcc85d0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:15.320641 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-18384dda-b10b-4611-91fa-ca286fcc85d0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:15.445214 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-18384dda-b10b-4611-91fa-ca286fcc85d0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:15.454082 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-18384dda-b10b-4611-91fa-ca286fcc85d0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:15.455552 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-18384dda-b10b-4611-91fa-ca286fcc85d0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:15.456845 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-18384dda-b10b-4611-91fa-ca286fcc85d0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1809 microversion: 2.20 time: 0.150250 Aug 12 11:53:15.457412 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 264/519] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:53:15 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:53:16.479455 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-aaf23b00-f7a9-4483-ab1d-006c305fde82 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:16.480061 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-aaf23b00-f7a9-4483-ab1d-006c305fde82 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:16.486423 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-aaf23b00-f7a9-4483-ab1d-006c305fde82 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:16.486935 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-aaf23b00-f7a9-4483-ab1d-006c305fde82 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:16.487372 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-aaf23b00-f7a9-4483-ab1d-006c305fde82 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:16.488062 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-aaf23b00-f7a9-4483-ab1d-006c305fde82 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:16.488518 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-aaf23b00-f7a9-4483-ab1d-006c305fde82 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:16.488946 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-aaf23b00-f7a9-4483-ab1d-006c305fde82 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:16.493799 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=100 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:53:16.620265 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-aaf23b00-f7a9-4483-ab1d-006c305fde82 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:16.628520 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-aaf23b00-f7a9-4483-ab1d-006c305fde82 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:16.629995 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-aaf23b00-f7a9-4483-ab1d-006c305fde82 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:16.631190 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-aaf23b00-f7a9-4483-ab1d-006c305fde82 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1809 microversion: 2.20 time: 0.155636 Aug 12 11:53:16.631730 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 256/520] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:53:16 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:53:17.653735 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-cbce2ec1-9aac-49e9-8d99-90648d4d8fef tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:17.654369 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-cbce2ec1-9aac-49e9-8d99-90648d4d8fef tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:17.660869 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cbce2ec1-9aac-49e9-8d99-90648d4d8fef tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:17.661344 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cbce2ec1-9aac-49e9-8d99-90648d4d8fef tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:17.661818 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cbce2ec1-9aac-49e9-8d99-90648d4d8fef tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:17.662513 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cbce2ec1-9aac-49e9-8d99-90648d4d8fef tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:17.662996 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cbce2ec1-9aac-49e9-8d99-90648d4d8fef tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:17.663417 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cbce2ec1-9aac-49e9-8d99-90648d4d8fef tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:17.790938 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-cbce2ec1-9aac-49e9-8d99-90648d4d8fef tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:17.799399 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-cbce2ec1-9aac-49e9-8d99-90648d4d8fef tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:17.800884 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-cbce2ec1-9aac-49e9-8d99-90648d4d8fef tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:17.802019 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-cbce2ec1-9aac-49e9-8d99-90648d4d8fef tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1809 microversion: 2.20 time: 0.152294 Aug 12 11:53:17.802583 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 265/521] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:53:17 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:53:17.980203 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-2ece4441-a0f2-4b12-a847-c11a342bd7c5 req-7c924266-a58e-4c7f-9ee9-0147d6035f49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712bb3a1-789a-442f-8d59-a635f0896531", "name": "network-vif-plugged", "status": "completed", "tag": "0a1aa4d3-f810-4d8a-b28b-30a0d82ce0c9"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:53:17.991763 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-2ece4441-a0f2-4b12-a847-c11a342bd7c5 req-7c924266-a58e-4c7f-9ee9-0147d6035f49 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:17.992305 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-2ece4441-a0f2-4b12-a847-c11a342bd7c5 req-7c924266-a58e-4c7f-9ee9-0147d6035f49 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:17.992879 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-2ece4441-a0f2-4b12-a847-c11a342bd7c5 req-7c924266-a58e-4c7f-9ee9-0147d6035f49 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:18.004494 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-2ece4441-a0f2-4b12-a847-c11a342bd7c5 req-7c924266-a58e-4c7f-9ee9-0147d6035f49 service nova] Creating event network-vif-plugged:0a1aa4d3-f810-4d8a-b28b-30a0d82ce0c9 for instance 712bb3a1-789a-442f-8d59-a635f0896531 on hv-cinder-85282 Aug 12 11:53:18.009473 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-2ece4441-a0f2-4b12-a847-c11a342bd7c5 req-7c924266-a58e-4c7f-9ee9-0147d6035f49 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032997 Aug 12 11:53:18.010208 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 257/522] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:53:18.825543 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-480fab87-6d50-45c7-9ac8-a1df46302407 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:18.826190 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-480fab87-6d50-45c7-9ac8-a1df46302407 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:18.832550 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-480fab87-6d50-45c7-9ac8-a1df46302407 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:18.833026 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-480fab87-6d50-45c7-9ac8-a1df46302407 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:18.833452 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-480fab87-6d50-45c7-9ac8-a1df46302407 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:18.834135 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-480fab87-6d50-45c7-9ac8-a1df46302407 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:18.834585 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-480fab87-6d50-45c7-9ac8-a1df46302407 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:18.835031 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-480fab87-6d50-45c7-9ac8-a1df46302407 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:18.968653 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-480fab87-6d50-45c7-9ac8-a1df46302407 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:18.976930 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-480fab87-6d50-45c7-9ac8-a1df46302407 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:18.978402 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-480fab87-6d50-45c7-9ac8-a1df46302407 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:18.979706 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-480fab87-6d50-45c7-9ac8-a1df46302407 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1809 microversion: 2.20 time: 0.157963 Aug 12 11:53:18.980260 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 266/523] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:53:18 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:53:20.004949 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-be08c276-19c4-46c7-80c3-772cb911fd81 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:20.005649 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-be08c276-19c4-46c7-80c3-772cb911fd81 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:20.011732 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-be08c276-19c4-46c7-80c3-772cb911fd81 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:20.012209 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-be08c276-19c4-46c7-80c3-772cb911fd81 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:20.012644 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-be08c276-19c4-46c7-80c3-772cb911fd81 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:20.013327 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-be08c276-19c4-46c7-80c3-772cb911fd81 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:20.013779 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-be08c276-19c4-46c7-80c3-772cb911fd81 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:20.014214 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-be08c276-19c4-46c7-80c3-772cb911fd81 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:20.140768 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-be08c276-19c4-46c7-80c3-772cb911fd81 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:20.149014 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-be08c276-19c4-46c7-80c3-772cb911fd81 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:20.150506 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-be08c276-19c4-46c7-80c3-772cb911fd81 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:20.151677 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-be08c276-19c4-46c7-80c3-772cb911fd81 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1809 microversion: 2.20 time: 0.152485 Aug 12 11:53:20.152225 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 258/524] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:53:19 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:53:21.175231 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-a8df9ebd-1b08-4290-b209-5db481406644 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:21.175842 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-a8df9ebd-1b08-4290-b209-5db481406644 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:21.182243 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a8df9ebd-1b08-4290-b209-5db481406644 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:21.182827 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a8df9ebd-1b08-4290-b209-5db481406644 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:21.183513 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a8df9ebd-1b08-4290-b209-5db481406644 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:21.184206 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a8df9ebd-1b08-4290-b209-5db481406644 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:21.184653 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a8df9ebd-1b08-4290-b209-5db481406644 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:21.185100 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a8df9ebd-1b08-4290-b209-5db481406644 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:21.319186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-a8df9ebd-1b08-4290-b209-5db481406644 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:21.327600 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-a8df9ebd-1b08-4290-b209-5db481406644 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:21.329085 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-a8df9ebd-1b08-4290-b209-5db481406644 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:21.330225 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-a8df9ebd-1b08-4290-b209-5db481406644 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1809 microversion: 2.20 time: 0.158920 Aug 12 11:53:21.330836 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 267/525] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:53:21 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:53:22.353383 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-81ea0630-2053-47a3-bb30-66d406212336 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:22.353997 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-81ea0630-2053-47a3-bb30-66d406212336 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:22.360673 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-81ea0630-2053-47a3-bb30-66d406212336 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:22.361152 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-81ea0630-2053-47a3-bb30-66d406212336 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:22.361586 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-81ea0630-2053-47a3-bb30-66d406212336 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:22.362271 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-81ea0630-2053-47a3-bb30-66d406212336 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:22.362753 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-81ea0630-2053-47a3-bb30-66d406212336 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:22.363179 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-81ea0630-2053-47a3-bb30-66d406212336 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:22.489871 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-81ea0630-2053-47a3-bb30-66d406212336 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:22.498757 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-81ea0630-2053-47a3-bb30-66d406212336 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:22.500239 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-81ea0630-2053-47a3-bb30-66d406212336 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:22.501381 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-81ea0630-2053-47a3-bb30-66d406212336 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1796 microversion: 2.20 time: 0.152117 Aug 12 11:53:22.501929 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 259/526] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:53:22 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1796 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:53:22.892488 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-38724d45-1a9c-4367-9188-0c3dc0c1961b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:22.892988 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-38724d45-1a9c-4367-9188-0c3dc0c1961b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:22.899584 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-38724d45-1a9c-4367-9188-0c3dc0c1961b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:22.900065 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-38724d45-1a9c-4367-9188-0c3dc0c1961b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:22.900495 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-38724d45-1a9c-4367-9188-0c3dc0c1961b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:22.901176 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-38724d45-1a9c-4367-9188-0c3dc0c1961b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:22.901627 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-38724d45-1a9c-4367-9188-0c3dc0c1961b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:22.902047 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-38724d45-1a9c-4367-9188-0c3dc0c1961b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:23.026992 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.objects.instance [None req-38724d45-1a9c-4367-9188-0c3dc0c1961b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lazy-loading 'services' on Instance uuid 6dba7589-a4cf-4842-953b-0218eae4d3db {{(pid=132281) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:53:23.136221 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-38724d45-1a9c-4367-9188-0c3dc0c1961b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db/os-volume_attachments/06f187bc-b87b-4731-b3c8-76197e816cdc" status: 202 len: 0 microversion: 2.1 time: 0.247401 Aug 12 11:53:23.136743 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 268/527] 10.222.0.42 () {58 vars in 1416 bytes} [Fri Aug 12 11:53:22 2022] DELETE /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db/os-volume_attachments/06f187bc-b87b-4731-b3c8-76197e816cdc => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:53:25.306136 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-8e7031a6-72d2-4ead-8bef-43ae24af3ca3 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:53:25.313050 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8e7031a6-72d2-4ead-8bef-43ae24af3ca3 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:25.313532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8e7031a6-72d2-4ead-8bef-43ae24af3ca3 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:25.313973 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8e7031a6-72d2-4ead-8bef-43ae24af3ca3 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:25.372937 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-8e7031a6-72d2-4ead-8bef-43ae24af3ca3 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Going to try to stop instance {{(pid=132282) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 12 11:53:25.413743 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-8e7031a6-72d2-4ead-8bef-43ae24af3ca3 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "POST /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db/action" status: 202 len: 0 microversion: 2.1 time: 0.111294 Aug 12 11:53:25.414442 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 260/528] 10.222.0.42 () {60 vars in 1278 bytes} [Fri Aug 12 11:53:25 2022] POST /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:53:25.424020 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-ec640abc-af60-4ccb-95fd-d55da9411a8c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:25.424714 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-ec640abc-af60-4ccb-95fd-d55da9411a8c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:25.430877 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ec640abc-af60-4ccb-95fd-d55da9411a8c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:25.431403 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ec640abc-af60-4ccb-95fd-d55da9411a8c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:25.431863 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ec640abc-af60-4ccb-95fd-d55da9411a8c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:25.432606 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ec640abc-af60-4ccb-95fd-d55da9411a8c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:25.433335 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ec640abc-af60-4ccb-95fd-d55da9411a8c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:25.433731 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ec640abc-af60-4ccb-95fd-d55da9411a8c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:25.562135 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-ec640abc-af60-4ccb-95fd-d55da9411a8c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:25.569516 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-ec640abc-af60-4ccb-95fd-d55da9411a8c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1679 microversion: 2.1 time: 0.150702 Aug 12 11:53:25.570075 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 269/529] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:25 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:26.455474 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-c9bdf2dc-71f2-4c89-aac1-16c33b6a4993 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:26.456046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-c9bdf2dc-71f2-4c89-aac1-16c33b6a4993 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:26.462042 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c9bdf2dc-71f2-4c89-aac1-16c33b6a4993 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:26.462515 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c9bdf2dc-71f2-4c89-aac1-16c33b6a4993 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:26.462976 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c9bdf2dc-71f2-4c89-aac1-16c33b6a4993 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:26.463651 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c9bdf2dc-71f2-4c89-aac1-16c33b6a4993 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:26.464098 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c9bdf2dc-71f2-4c89-aac1-16c33b6a4993 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:26.464512 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c9bdf2dc-71f2-4c89-aac1-16c33b6a4993 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:26.487493 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-c9bdf2dc-71f2-4c89-aac1-16c33b6a4993 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f/ips" status: 200 len: 149 microversion: 2.1 time: 0.037239 Aug 12 11:53:26.488027 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 261/530] 10.222.0.42 () {58 vars in 1248 bytes} [Fri Aug 12 11:53:26 2022] GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:53:26.499193 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-0a0cd8ee-69e2-44b9-875c-a3abe2706997 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4da5e068-1358-4aa4-b164-f93909d60a78"}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:53:26.501514 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-0a0cd8ee-69e2-44b9-875c-a3abe2706997 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:26.507750 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0a0cd8ee-69e2-44b9-875c-a3abe2706997 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:26.508215 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0a0cd8ee-69e2-44b9-875c-a3abe2706997 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:26.508653 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0a0cd8ee-69e2-44b9-875c-a3abe2706997 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:26.509304 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0a0cd8ee-69e2-44b9-875c-a3abe2706997 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:26.509744 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0a0cd8ee-69e2-44b9-875c-a3abe2706997 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:26.510155 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0a0cd8ee-69e2-44b9-875c-a3abe2706997 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:26.590083 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-5e348853-30c1-44f2-9ff8-96a744166fe7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:26.590717 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-5e348853-30c1-44f2-9ff8-96a744166fe7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:26.591162 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.wsgi [None req-0a0cd8ee-69e2-44b9-875c-a3abe2706997 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] HTTP exception thrown: Invalid volume: volume 4da5e068-1358-4aa4-b164-f93909d60a78 is already attached to instances: d4ed98fc-5acc-42ec-9b95-86fc33117c65 Aug 12 11:53:26.592861 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-0a0cd8ee-69e2-44b9-875c-a3abe2706997 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Request method failure captured: Aug 12 11:53:26.592861 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: POST /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f/os-volume_attachments HTTP/1.1 Aug 12 11:53:26.592861 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 11:53:26.592861 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 11:53:26.592861 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 11:53:26.592861 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 74 Aug 12 11:53:26.592861 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 11:53:26.592861 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 11:53:26.592861 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 11:53:26.592861 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 11:53:26.592861 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9j5b93D9DFn6geUGIXSqCWNPRsOoFCQh7K0YJu6U1z8M-82hV_MMW-0Rx_RsrS3lVH4yCHqvGV-EIGSy6uHXvN26xND935rxaQQze8S1cibmQ_P5YQQSOUKlcTJjvmH8tXnzK6aYRsotianp-i1gOUOwU_1_GVtqTppajmycDWrHY6k Aug 12 11:53:26.592861 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 11:53:26.592861 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 11:53:26.592861 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 11:53:26.592861 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 11:53:26.592861 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 11:53:26.592861 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 11:53:26.592861 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: 8299891a8d134af4be3f84cdc7abec51 Aug 12 11:53:26.592861 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:53:26.592861 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 11:53:26.592861 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 11:53:26.594229 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8299891a8d134af4be3f84cdc7abec51", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8299891a8d134af4be3f84cdc7abec51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8299891a8d134af4be3f84cdc7abec51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8299891a8d134af4be3f84cdc7abec51"}]}] Aug 12 11:53:26.594229 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:53:26.594229 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: 8299891a8d134af4be3f84cdc7abec51 Aug 12 11:53:26.594229 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:53:26.594229 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-AttachVolumeNegativeTest-1716385367-project Aug 12 11:53:26.594229 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 11:53:26.594229 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 11:53:26.594229 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: 72a30400dec14a85889af8d8dd59886e Aug 12 11:53:26.594229 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-AttachVolumeNegativeTest-1716385367-project Aug 12 11:53:26.594229 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Aug 12 11:53:26.594229 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {"volumeAttachment": {"volumeId": "4da5e068-1358-4aa4-b164-f93909d60a78"}} Aug 12 11:53:26.594229 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: > Aug 12 11:53:26.595040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Invalid volume: volume 4da5e068-1358-4aa4-b164-f93909d60a78 is already attached to instances: d4ed98fc-5acc-42ec-9b95-86fc33117c65 Aug 12 11:53:26.595040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'server_id': '4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f', 'body': {'volumeAttachment': {'volumeId': '4da5e068-1358-4aa4-b164-f93909d60a78'}}} Aug 12 11:53:26.595040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:53:26.595040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:53:26.595040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 12 11:53:26.595040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 12 11:53:26.595040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 12 11:53:26.595040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 12 11:53:26.595040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 12 11:53:26.595040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 12 11:53:26.595040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 12 11:53:26.595040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 12 11:53:26.595040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 12 11:53:26.595040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 12 11:53:26.595040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4da5e068-1358-4aa4-b164-f93909d60a78 is already attached to instances: d4ed98fc-5acc-42ec-9b95-86fc33117c65 Aug 12 11:53:26.595040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:53:26.595040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:53:26.595040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:53:26.595040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:53:26.596219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:53:26.596219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:53:26.596219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:53:26.596219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:53:26.596219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:53:26.596219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:53:26.596219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 11:53:26.596219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 11:53:26.596219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 11:53:26.596219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 11:53:26.596219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 11:53:26.596219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 11:53:26.596219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 12 11:53:26.596219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 12 11:53:26.596219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4da5e068-1358-4aa4-b164-f93909d60a78 is already attached to instances: d4ed98fc-5acc-42ec-9b95-86fc33117c65 Aug 12 11:53:26.596219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:53:26.596219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:53:26.596219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:53:26.596219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:53:26.596219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:53:26.597401 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:53:26.597401 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:53:26.597401 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:53:26.597401 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4da5e068-1358-4aa4-b164-f93909d60a78 is already attached to instances: d4ed98fc-5acc-42ec-9b95-86fc33117c65 Aug 12 11:53:26.597401 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:53:26.597401 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-0a0cd8ee-69e2-44b9-875c-a3abe2706997 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Returning 400 to user: Invalid volume: volume 4da5e068-1358-4aa4-b164-f93909d60a78 is already attached to instances: d4ed98fc-5acc-42ec-9b95-86fc33117c65 {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:53:26.597401 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-0a0cd8ee-69e2-44b9-875c-a3abe2706997 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "POST /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099087 Aug 12 11:53:26.597401 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 270/531] 10.222.0.42 () {60 vars in 1323 bytes} [Fri Aug 12 11:53:26 2022] POST /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 12 11:53:26.597925 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5e348853-30c1-44f2-9ff8-96a744166fe7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:26.597925 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5e348853-30c1-44f2-9ff8-96a744166fe7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:26.598083 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5e348853-30c1-44f2-9ff8-96a744166fe7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:26.598732 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5e348853-30c1-44f2-9ff8-96a744166fe7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:26.599198 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5e348853-30c1-44f2-9ff8-96a744166fe7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:26.599564 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5e348853-30c1-44f2-9ff8-96a744166fe7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:26.602649 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-8ed919bd-79a5-4825-84a2-d6af56babbb8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:26.603136 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-8ed919bd-79a5-4825-84a2-d6af56babbb8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:26.608861 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8ed919bd-79a5-4825-84a2-d6af56babbb8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:26.609337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8ed919bd-79a5-4825-84a2-d6af56babbb8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:26.609840 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8ed919bd-79a5-4825-84a2-d6af56babbb8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:26.610443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8ed919bd-79a5-4825-84a2-d6af56babbb8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:26.610985 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8ed919bd-79a5-4825-84a2-d6af56babbb8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:26.611380 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8ed919bd-79a5-4825-84a2-d6af56babbb8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:26.636632 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-8ed919bd-79a5-4825-84a2-d6af56babbb8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Going to try to terminate instance {{(pid=132281) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 11:53:26.713587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-8ed919bd-79a5-4825-84a2-d6af56babbb8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f" status: 204 len: 0 microversion: 2.1 time: 0.113828 Aug 12 11:53:26.714276 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 271/532] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Aug 12 11:53:26 2022] DELETE /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 12 11:53:26.724455 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-43cc5e90-ab38-4b1b-800f-868d8a21101f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:26.725145 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-43cc5e90-ab38-4b1b-800f-868d8a21101f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:26.730932 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-43cc5e90-ab38-4b1b-800f-868d8a21101f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:26.731416 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-43cc5e90-ab38-4b1b-800f-868d8a21101f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:26.731866 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-43cc5e90-ab38-4b1b-800f-868d8a21101f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:26.732560 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-43cc5e90-ab38-4b1b-800f-868d8a21101f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:26.733010 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-43cc5e90-ab38-4b1b-800f-868d8a21101f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:26.733124 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-5e348853-30c1-44f2-9ff8-96a744166fe7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:26.733431 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-43cc5e90-ab38-4b1b-800f-868d8a21101f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:26.740493 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-5e348853-30c1-44f2-9ff8-96a744166fe7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1679 microversion: 2.1 time: 0.154196 Aug 12 11:53:26.741049 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 262/533] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:26 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:53:26.860364 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-43cc5e90-ab38-4b1b-800f-868d8a21101f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:26.867941 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-43cc5e90-ab38-4b1b-800f-868d8a21101f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f" status: 200 len: 1681 microversion: 2.1 time: 0.148304 Aug 12 11:53:26.868496 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 272/534] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:26 2022] GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:27.763898 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-196d60df-43dc-4845-84ba-77f8ccdb4c9b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:27.764509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-196d60df-43dc-4845-84ba-77f8ccdb4c9b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:27.770903 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-196d60df-43dc-4845-84ba-77f8ccdb4c9b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:27.771386 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-196d60df-43dc-4845-84ba-77f8ccdb4c9b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:27.771884 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-196d60df-43dc-4845-84ba-77f8ccdb4c9b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:27.772573 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-196d60df-43dc-4845-84ba-77f8ccdb4c9b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:27.773028 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-196d60df-43dc-4845-84ba-77f8ccdb4c9b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:27.773453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-196d60df-43dc-4845-84ba-77f8ccdb4c9b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:27.889773 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-a233ce33-8241-408e-b31a-a34ad58c539d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:27.890384 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-a233ce33-8241-408e-b31a-a34ad58c539d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:27.896416 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a233ce33-8241-408e-b31a-a34ad58c539d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:27.896890 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a233ce33-8241-408e-b31a-a34ad58c539d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:27.897319 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a233ce33-8241-408e-b31a-a34ad58c539d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:27.898059 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a233ce33-8241-408e-b31a-a34ad58c539d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:27.898508 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a233ce33-8241-408e-b31a-a34ad58c539d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:27.898960 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a233ce33-8241-408e-b31a-a34ad58c539d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:27.905144 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-196d60df-43dc-4845-84ba-77f8ccdb4c9b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:27.912562 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-196d60df-43dc-4845-84ba-77f8ccdb4c9b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1679 microversion: 2.1 time: 0.153064 Aug 12 11:53:27.913111 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 263/535] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:27 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:28.025838 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-a233ce33-8241-408e-b31a-a34ad58c539d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:28.033764 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-a233ce33-8241-408e-b31a-a34ad58c539d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f" status: 200 len: 1681 microversion: 2.1 time: 0.148326 Aug 12 11:53:28.034315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 273/536] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:27 2022] GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:53:28.934019 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-2fcc73c5-091e-4906-a5b3-136784b3c9d7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:28.934787 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-2fcc73c5-091e-4906-a5b3-136784b3c9d7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:28.937200 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_api:SELECT=32 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:53:28.942348 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2fcc73c5-091e-4906-a5b3-136784b3c9d7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:28.942861 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2fcc73c5-091e-4906-a5b3-136784b3c9d7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:28.943290 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2fcc73c5-091e-4906-a5b3-136784b3c9d7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:28.943976 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2fcc73c5-091e-4906-a5b3-136784b3c9d7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:28.944425 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2fcc73c5-091e-4906-a5b3-136784b3c9d7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:28.944875 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2fcc73c5-091e-4906-a5b3-136784b3c9d7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:29.055640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-09a7c0cc-5cfe-428f-809d-389c9a6b79df tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:29.056294 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-09a7c0cc-5cfe-428f-809d-389c9a6b79df tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:29.062898 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-09a7c0cc-5cfe-428f-809d-389c9a6b79df tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:29.063379 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-09a7c0cc-5cfe-428f-809d-389c9a6b79df tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:29.063808 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-09a7c0cc-5cfe-428f-809d-389c9a6b79df tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:29.064493 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-09a7c0cc-5cfe-428f-809d-389c9a6b79df tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:29.064939 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-09a7c0cc-5cfe-428f-809d-389c9a6b79df tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:29.065357 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-09a7c0cc-5cfe-428f-809d-389c9a6b79df tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:29.434593 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-2fcc73c5-091e-4906-a5b3-136784b3c9d7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:29.442339 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-2fcc73c5-091e-4906-a5b3-136784b3c9d7 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1679 microversion: 2.1 time: 0.512509 Aug 12 11:53:29.442927 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 264/537] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:28 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1679 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:29.523053 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-09a7c0cc-5cfe-428f-809d-389c9a6b79df tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:29.531357 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-09a7c0cc-5cfe-428f-809d-389c9a6b79df tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f" status: 200 len: 1681 microversion: 2.1 time: 0.479475 Aug 12 11:53:29.532033 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 274/538] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:29 2022] GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f => generated 1681 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:53:29.788186 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-57237fae-727a-4cf7-aa05-cc8722632acf req-69d919c1-a68f-4021-8dcb-d81c3bbd0a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f", "name": "network-vif-deleted", "tag": "672dff2d-d9db-457b-b48d-9e22194e90c7"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:53:29.798077 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-57237fae-727a-4cf7-aa05-cc8722632acf req-69d919c1-a68f-4021-8dcb-d81c3bbd0a8c service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:29.798592 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-57237fae-727a-4cf7-aa05-cc8722632acf req-69d919c1-a68f-4021-8dcb-d81c3bbd0a8c service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:29.799030 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-57237fae-727a-4cf7-aa05-cc8722632acf req-69d919c1-a68f-4021-8dcb-d81c3bbd0a8c service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:29.811842 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-57237fae-727a-4cf7-aa05-cc8722632acf req-69d919c1-a68f-4021-8dcb-d81c3bbd0a8c service nova] Creating event network-vif-deleted:672dff2d-d9db-457b-b48d-9e22194e90c7 for instance 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f on hv-cinder-85282 Aug 12 11:53:29.817114 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-57237fae-727a-4cf7-aa05-cc8722632acf req-69d919c1-a68f-4021-8dcb-d81c3bbd0a8c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033080 Aug 12 11:53:29.821060 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 265/539] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:53:30.463677 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-86ec3f34-d72b-4aae-a568-7b92097127ff tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:30.464333 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-86ec3f34-d72b-4aae-a568-7b92097127ff tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:30.472729 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86ec3f34-d72b-4aae-a568-7b92097127ff tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:30.473592 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86ec3f34-d72b-4aae-a568-7b92097127ff tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:30.474032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86ec3f34-d72b-4aae-a568-7b92097127ff tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:30.475212 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86ec3f34-d72b-4aae-a568-7b92097127ff tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:30.475689 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86ec3f34-d72b-4aae-a568-7b92097127ff tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:30.476838 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86ec3f34-d72b-4aae-a568-7b92097127ff tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:30.555142 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-2175e96d-2064-4833-980b-beb2573bf84d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:30.556509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-2175e96d-2064-4833-980b-beb2573bf84d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:30.564157 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2175e96d-2064-4833-980b-beb2573bf84d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:30.564894 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2175e96d-2064-4833-980b-beb2573bf84d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:30.565551 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2175e96d-2064-4833-980b-beb2573bf84d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:30.566635 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2175e96d-2064-4833-980b-beb2573bf84d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:30.567151 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2175e96d-2064-4833-980b-beb2573bf84d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:30.567815 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2175e96d-2064-4833-980b-beb2573bf84d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:30.582914 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.wsgi [None req-2175e96d-2064-4833-980b-beb2573bf84d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] HTTP exception thrown: Instance 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f could not be found. Aug 12 11:53:30.585434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-2175e96d-2064-4833-980b-beb2573bf84d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Request method failure captured: Aug 12 11:53:30.585434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f HTTP/1.1 Aug 12 11:53:30.585434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 11:53:30.585434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 11:53:30.585434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 11:53:30.585434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 0 Aug 12 11:53:30.585434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 11:53:30.585434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 11:53:30.585434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 11:53:30.585434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 11:53:30.585434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9j5b93D9DFn6geUGIXSqCWNPRsOoFCQh7K0YJu6U1z8M-82hV_MMW-0Rx_RsrS3lVH4yCHqvGV-EIGSy6uHXvN26xND935rxaQQze8S1cibmQ_P5YQQSOUKlcTJjvmH8tXnzK6aYRsotianp-i1gOUOwU_1_GVtqTppajmycDWrHY6k Aug 12 11:53:30.585434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 11:53:30.585434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 11:53:30.585434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 11:53:30.585434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 11:53:30.585434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 11:53:30.585434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 11:53:30.585434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: 8299891a8d134af4be3f84cdc7abec51 Aug 12 11:53:30.585434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:53:30.585434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 11:53:30.585434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 11:53:30.587074 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8299891a8d134af4be3f84cdc7abec51", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8299891a8d134af4be3f84cdc7abec51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8299891a8d134af4be3f84cdc7abec51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8299891a8d134af4be3f84cdc7abec51"}]}] Aug 12 11:53:30.587074 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:53:30.587074 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: 8299891a8d134af4be3f84cdc7abec51 Aug 12 11:53:30.587074 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:53:30.587074 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-AttachVolumeNegativeTest-1716385367-project Aug 12 11:53:30.587074 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 11:53:30.587074 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 11:53:30.587074 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: 72a30400dec14a85889af8d8dd59886e Aug 12 11:53:30.587074 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-AttachVolumeNegativeTest-1716385367-project Aug 12 11:53:30.587074 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: > Aug 12 11:53:30.587074 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Instance 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f could not be found. Aug 12 11:53:30.587074 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'id': '4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f'} Aug 12 11:53:30.587977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:53:30.587977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:53:30.587977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:53:30.587977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:53:30.587977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:53:30.587977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:53:30.587977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:53:30.587977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:53:30.587977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:53:30.587977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:53:30.587977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f could not be found. Aug 12 11:53:30.587977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:53:30.587977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:53:30.587977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:53:30.587977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:53:30.587977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:53:30.587977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:53:30.587977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:53:30.587977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:53:30.587977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:53:30.589438 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:53:30.589438 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:53:30.589438 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:53:30.589438 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:53:30.589438 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:53:30.589438 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:53:30.589438 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:53:30.589438 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f could not be found. Aug 12 11:53:30.589438 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:53:30.589438 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:53:30.589438 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:53:30.589438 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:53:30.589438 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:53:30.589438 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:53:30.589438 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:53:30.589438 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:53:30.589438 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f could not be found. Aug 12 11:53:30.589438 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:53:30.592247 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-2175e96d-2064-4833-980b-beb2573bf84d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Returning 404 to user: Instance 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f could not be found. {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:53:30.593332 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-2175e96d-2064-4833-980b-beb2573bf84d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f" status: 404 len: 111 microversion: 2.1 time: 0.042929 Aug 12 11:53:30.593959 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 266/540] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:30 2022] GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:53:30.602807 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-35d6d9e6-064e-467a-8f87-4579d49e3703 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '.version_select at 0x7f3e583daaf0>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:30.617359 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-86ec3f34-d72b-4aae-a568-7b92097127ff tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:30.621351 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:53:30.628572 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-35d6d9e6-064e-467a-8f87-4579d49e3703 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1488307215" status: 202 len: 0 microversion: 2.1 time: 0.029512 Aug 12 11:53:30.629392 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 267/541] 10.222.0.42 () {58 vars in 1221 bytes} [Fri Aug 12 11:53:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1488307215 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:53:30.629955 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-86ec3f34-d72b-4aae-a568-7b92097127ff tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1679 microversion: 2.1 time: 0.170095 Aug 12 11:53:30.630540 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 275/542] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:30 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:53:30.739472 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-cbde3042-ab42-4266-86c3-17dc78d00aeb tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:53:30.743108 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-cbde3042-ab42-4266-86c3-17dc78d00aeb tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:30.750983 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cbde3042-ab42-4266-86c3-17dc78d00aeb tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:30.751881 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cbde3042-ab42-4266-86c3-17dc78d00aeb tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:30.752497 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cbde3042-ab42-4266-86c3-17dc78d00aeb tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:30.753204 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cbde3042-ab42-4266-86c3-17dc78d00aeb tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:30.753856 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cbde3042-ab42-4266-86c3-17dc78d00aeb tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:30.754438 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cbde3042-ab42-4266-86c3-17dc78d00aeb tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:30.886644 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-cbde3042-ab42-4266-86c3-17dc78d00aeb tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "POST /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e/action" status: 202 len: 0 microversion: 2.1 time: 0.152554 Aug 12 11:53:30.887797 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 268/543] 10.222.0.42 () {60 vars in 1278 bytes} [Fri Aug 12 11:53:30 2022] POST /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 12 11:53:30.901749 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-6bf4e287-13df-4471-8e98-ab9c66d5f8d1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:30.902636 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-6bf4e287-13df-4471-8e98-ab9c66d5f8d1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:30.912082 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6bf4e287-13df-4471-8e98-ab9c66d5f8d1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:30.912847 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6bf4e287-13df-4471-8e98-ab9c66d5f8d1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:30.913442 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6bf4e287-13df-4471-8e98-ab9c66d5f8d1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:30.914308 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6bf4e287-13df-4471-8e98-ab9c66d5f8d1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:30.914935 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6bf4e287-13df-4471-8e98-ab9c66d5f8d1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:30.915508 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6bf4e287-13df-4471-8e98-ab9c66d5f8d1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:31.244425 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-6bf4e287-13df-4471-8e98-ab9c66d5f8d1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:31.253951 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-6bf4e287-13df-4471-8e98-ab9c66d5f8d1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1750 microversion: 2.1 time: 0.360938 Aug 12 11:53:31.269472 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 276/544] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:30 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1750 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:31.652274 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d19772ec-f3c4-48ac-bc75-07e516ce778f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:31.653593 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d19772ec-f3c4-48ac-bc75-07e516ce778f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:31.660449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d19772ec-f3c4-48ac-bc75-07e516ce778f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:31.660949 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d19772ec-f3c4-48ac-bc75-07e516ce778f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:31.661389 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d19772ec-f3c4-48ac-bc75-07e516ce778f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:31.662114 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d19772ec-f3c4-48ac-bc75-07e516ce778f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:31.662571 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d19772ec-f3c4-48ac-bc75-07e516ce778f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:31.663031 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d19772ec-f3c4-48ac-bc75-07e516ce778f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:31.828342 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-5c25fcf2-4591-48ce-9f7d-7c3a3c48c071 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:31.828868 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-5c25fcf2-4591-48ce-9f7d-7c3a3c48c071 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:31.835864 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5c25fcf2-4591-48ce-9f7d-7c3a3c48c071 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:31.836350 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5c25fcf2-4591-48ce-9f7d-7c3a3c48c071 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:31.836773 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5c25fcf2-4591-48ce-9f7d-7c3a3c48c071 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:31.837488 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5c25fcf2-4591-48ce-9f7d-7c3a3c48c071 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:31.837929 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5c25fcf2-4591-48ce-9f7d-7c3a3c48c071 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:31.838341 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5c25fcf2-4591-48ce-9f7d-7c3a3c48c071 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:31.905515 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d19772ec-f3c4-48ac-bc75-07e516ce778f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:31.913601 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-d19772ec-f3c4-48ac-bc75-07e516ce778f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1679 microversion: 2.1 time: 0.266023 Aug 12 11:53:31.925432 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 269/545] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:31 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1679 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:31.928426 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.objects.instance [None req-5c25fcf2-4591-48ce-9f7d-7c3a3c48c071 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lazy-loading 'services' on Instance uuid d4ed98fc-5acc-42ec-9b95-86fc33117c65 {{(pid=132281) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:53:32.003224 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-5c25fcf2-4591-48ce-9f7d-7c3a3c48c071 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65/os-volume_attachments/4da5e068-1358-4aa4-b164-f93909d60a78" status: 202 len: 0 microversion: 2.1 time: 0.178628 Aug 12 11:53:32.003815 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 277/546] 10.222.0.42 () {58 vars in 1416 bytes} [Fri Aug 12 11:53:31 2022] DELETE /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65/os-volume_attachments/4da5e068-1358-4aa4-b164-f93909d60a78 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:53:32.012074 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-6244fdaa-dc46-40cd-9c6b-353ec5c5f058 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:32.014264 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-6244fdaa-dc46-40cd-9c6b-353ec5c5f058 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:32.020276 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6244fdaa-dc46-40cd-9c6b-353ec5c5f058 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:32.020748 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6244fdaa-dc46-40cd-9c6b-353ec5c5f058 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:32.021175 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6244fdaa-dc46-40cd-9c6b-353ec5c5f058 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:32.021851 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6244fdaa-dc46-40cd-9c6b-353ec5c5f058 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:32.022292 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6244fdaa-dc46-40cd-9c6b-353ec5c5f058 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:32.022734 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6244fdaa-dc46-40cd-9c6b-353ec5c5f058 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:32.053724 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-6244fdaa-dc46-40cd-9c6b-353ec5c5f058 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045499 Aug 12 11:53:32.054259 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 270/547] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Aug 12 11:53:32 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:53:32.276516 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-9f2430bb-7354-454f-a43e-3d17483eebe1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:32.277213 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-9f2430bb-7354-454f-a43e-3d17483eebe1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:32.284117 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9f2430bb-7354-454f-a43e-3d17483eebe1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:32.284598 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9f2430bb-7354-454f-a43e-3d17483eebe1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:32.285027 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9f2430bb-7354-454f-a43e-3d17483eebe1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:32.285712 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9f2430bb-7354-454f-a43e-3d17483eebe1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:32.286186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9f2430bb-7354-454f-a43e-3d17483eebe1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:32.286615 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9f2430bb-7354-454f-a43e-3d17483eebe1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:32.427561 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-9f2430bb-7354-454f-a43e-3d17483eebe1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:32.436126 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-9f2430bb-7354-454f-a43e-3d17483eebe1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1755 microversion: 2.1 time: 0.163625 Aug 12 11:53:32.436710 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 278/548] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:32 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:32.936825 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-916cc3ac-e6cd-4061-a1c3-70306d158848 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:32.937457 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-916cc3ac-e6cd-4061-a1c3-70306d158848 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:32.944030 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-916cc3ac-e6cd-4061-a1c3-70306d158848 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:32.944505 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-916cc3ac-e6cd-4061-a1c3-70306d158848 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:32.944936 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-916cc3ac-e6cd-4061-a1c3-70306d158848 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:32.945608 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-916cc3ac-e6cd-4061-a1c3-70306d158848 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:32.946052 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-916cc3ac-e6cd-4061-a1c3-70306d158848 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:32.946468 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-916cc3ac-e6cd-4061-a1c3-70306d158848 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:33.066106 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-754357a5-e0a5-40ee-b002-e2c9892d552f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:33.069280 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-754357a5-e0a5-40ee-b002-e2c9892d552f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:33.076165 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-754357a5-e0a5-40ee-b002-e2c9892d552f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:33.076647 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-754357a5-e0a5-40ee-b002-e2c9892d552f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:33.077076 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-754357a5-e0a5-40ee-b002-e2c9892d552f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:33.077769 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-754357a5-e0a5-40ee-b002-e2c9892d552f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:33.078046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-916cc3ac-e6cd-4061-a1c3-70306d158848 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:33.078232 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-754357a5-e0a5-40ee-b002-e2c9892d552f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:33.078653 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-754357a5-e0a5-40ee-b002-e2c9892d552f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:33.085381 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-916cc3ac-e6cd-4061-a1c3-70306d158848 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1679 microversion: 2.1 time: 0.153200 Aug 12 11:53:33.085934 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 271/549] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:32 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:33.107739 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-754357a5-e0a5-40ee-b002-e2c9892d552f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045621 Aug 12 11:53:33.108285 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 279/550] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Aug 12 11:53:33 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:53:33.457365 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-952883d6-c65c-4d04-ba23-0bbb45650235 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:33.457923 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-952883d6-c65c-4d04-ba23-0bbb45650235 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:33.463858 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-952883d6-c65c-4d04-ba23-0bbb45650235 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:33.464331 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-952883d6-c65c-4d04-ba23-0bbb45650235 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:33.464762 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-952883d6-c65c-4d04-ba23-0bbb45650235 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:33.465438 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-952883d6-c65c-4d04-ba23-0bbb45650235 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:33.465886 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-952883d6-c65c-4d04-ba23-0bbb45650235 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:33.466840 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-952883d6-c65c-4d04-ba23-0bbb45650235 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:33.609911 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-952883d6-c65c-4d04-ba23-0bbb45650235 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:33.617740 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-952883d6-c65c-4d04-ba23-0bbb45650235 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1755 microversion: 2.1 time: 0.164244 Aug 12 11:53:33.618282 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 272/551] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:33 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:34.106298 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-4a9f31b3-a983-4328-b83e-ccb3839af37b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:34.106925 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-4a9f31b3-a983-4328-b83e-ccb3839af37b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:34.113243 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4a9f31b3-a983-4328-b83e-ccb3839af37b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:34.113739 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4a9f31b3-a983-4328-b83e-ccb3839af37b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:34.114167 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4a9f31b3-a983-4328-b83e-ccb3839af37b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:34.114864 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4a9f31b3-a983-4328-b83e-ccb3839af37b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:34.115305 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4a9f31b3-a983-4328-b83e-ccb3839af37b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:34.115715 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4a9f31b3-a983-4328-b83e-ccb3839af37b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:34.120108 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-edd99652-39ea-4b1c-97ff-724455334d21 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:34.122905 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-edd99652-39ea-4b1c-97ff-724455334d21 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:34.129234 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-edd99652-39ea-4b1c-97ff-724455334d21 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:34.129659 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-edd99652-39ea-4b1c-97ff-724455334d21 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:34.130103 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-edd99652-39ea-4b1c-97ff-724455334d21 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:34.130830 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-edd99652-39ea-4b1c-97ff-724455334d21 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:34.131281 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-edd99652-39ea-4b1c-97ff-724455334d21 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:34.131707 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-edd99652-39ea-4b1c-97ff-724455334d21 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:34.160788 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-edd99652-39ea-4b1c-97ff-724455334d21 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044553 Aug 12 11:53:34.161349 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 273/552] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Aug 12 11:53:34 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 11:53:34.223641 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-9c57e44b-3080-4ff8-9dec-7941846c3589 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:34.224134 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-9c57e44b-3080-4ff8-9dec-7941846c3589 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:34.229935 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9c57e44b-3080-4ff8-9dec-7941846c3589 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:34.230414 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9c57e44b-3080-4ff8-9dec-7941846c3589 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:34.230889 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9c57e44b-3080-4ff8-9dec-7941846c3589 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:34.231998 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9c57e44b-3080-4ff8-9dec-7941846c3589 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:34.231998 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9c57e44b-3080-4ff8-9dec-7941846c3589 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:34.232426 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9c57e44b-3080-4ff8-9dec-7941846c3589 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:34.236466 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:53:34.249901 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-4a9f31b3-a983-4328-b83e-ccb3839af37b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:34.258044 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-4a9f31b3-a983-4328-b83e-ccb3839af37b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1679 microversion: 2.1 time: 0.155499 Aug 12 11:53:34.258636 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 280/553] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:34 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:34.259579 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-9c57e44b-3080-4ff8-9dec-7941846c3589 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Going to try to terminate instance {{(pid=132282) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 11:53:34.340042 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-9c57e44b-3080-4ff8-9dec-7941846c3589 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 204 len: 0 microversion: 2.1 time: 0.119924 Aug 12 11:53:34.340651 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 274/554] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Aug 12 11:53:34 2022] DELETE /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 12 11:53:34.348655 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-96abdfb6-abf1-44ce-887a-0d27f8407c9e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:34.349272 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-96abdfb6-abf1-44ce-887a-0d27f8407c9e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:34.355037 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-96abdfb6-abf1-44ce-887a-0d27f8407c9e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:34.355514 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-96abdfb6-abf1-44ce-887a-0d27f8407c9e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:34.355938 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-96abdfb6-abf1-44ce-887a-0d27f8407c9e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:34.356615 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-96abdfb6-abf1-44ce-887a-0d27f8407c9e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:34.357085 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-96abdfb6-abf1-44ce-887a-0d27f8407c9e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:34.357500 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-96abdfb6-abf1-44ce-887a-0d27f8407c9e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:34.481147 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-96abdfb6-abf1-44ce-887a-0d27f8407c9e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:34.488937 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-96abdfb6-abf1-44ce-887a-0d27f8407c9e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1682 microversion: 2.1 time: 0.144073 Aug 12 11:53:34.489492 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 281/555] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:34 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1682 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:53:34.639566 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-8bf71f2b-23bd-4364-bbe0-8ada85fd7240 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:34.640261 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-8bf71f2b-23bd-4364-bbe0-8ada85fd7240 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:34.646117 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8bf71f2b-23bd-4364-bbe0-8ada85fd7240 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:34.646591 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8bf71f2b-23bd-4364-bbe0-8ada85fd7240 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:34.647053 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8bf71f2b-23bd-4364-bbe0-8ada85fd7240 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:34.647733 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8bf71f2b-23bd-4364-bbe0-8ada85fd7240 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:34.648180 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8bf71f2b-23bd-4364-bbe0-8ada85fd7240 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:34.648601 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8bf71f2b-23bd-4364-bbe0-8ada85fd7240 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:34.788940 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-8bf71f2b-23bd-4364-bbe0-8ada85fd7240 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:34.797282 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-8bf71f2b-23bd-4364-bbe0-8ada85fd7240 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1755 microversion: 2.1 time: 0.161993 Aug 12 11:53:34.797871 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 275/556] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:34 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:35.279497 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-db9873d8-9c8a-469f-bbfd-4a385fb5d212 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:35.280097 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-db9873d8-9c8a-469f-bbfd-4a385fb5d212 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:35.286417 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-db9873d8-9c8a-469f-bbfd-4a385fb5d212 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:35.286920 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-db9873d8-9c8a-469f-bbfd-4a385fb5d212 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:35.287354 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-db9873d8-9c8a-469f-bbfd-4a385fb5d212 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:35.288035 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-db9873d8-9c8a-469f-bbfd-4a385fb5d212 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:35.288482 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-db9873d8-9c8a-469f-bbfd-4a385fb5d212 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:35.288897 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-db9873d8-9c8a-469f-bbfd-4a385fb5d212 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:35.414338 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-db9873d8-9c8a-469f-bbfd-4a385fb5d212 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:35.421927 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-db9873d8-9c8a-469f-bbfd-4a385fb5d212 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1679 microversion: 2.1 time: 0.146824 Aug 12 11:53:35.422493 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 282/557] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:35 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:35.511391 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-57059f6b-6314-49fe-ac2e-d7fbc7bd47da tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:35.511967 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-57059f6b-6314-49fe-ac2e-d7fbc7bd47da tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:35.518772 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-57059f6b-6314-49fe-ac2e-d7fbc7bd47da tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:35.519252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-57059f6b-6314-49fe-ac2e-d7fbc7bd47da tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:35.519683 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-57059f6b-6314-49fe-ac2e-d7fbc7bd47da tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:35.520368 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-57059f6b-6314-49fe-ac2e-d7fbc7bd47da tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:35.520819 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-57059f6b-6314-49fe-ac2e-d7fbc7bd47da tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:35.521243 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-57059f6b-6314-49fe-ac2e-d7fbc7bd47da tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:35.657476 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-57059f6b-6314-49fe-ac2e-d7fbc7bd47da tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:35.664852 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-57059f6b-6314-49fe-ac2e-d7fbc7bd47da tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1682 microversion: 2.1 time: 0.157360 Aug 12 11:53:35.665415 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 276/558] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:35 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:35.825093 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-17131ad6-0cf1-497a-8586-a696c7321bc5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:35.826259 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-17131ad6-0cf1-497a-8586-a696c7321bc5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:35.832272 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-17131ad6-0cf1-497a-8586-a696c7321bc5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:35.832746 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-17131ad6-0cf1-497a-8586-a696c7321bc5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:35.833175 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-17131ad6-0cf1-497a-8586-a696c7321bc5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:35.833862 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-17131ad6-0cf1-497a-8586-a696c7321bc5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:35.834311 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-17131ad6-0cf1-497a-8586-a696c7321bc5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:35.834770 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-17131ad6-0cf1-497a-8586-a696c7321bc5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:35.973911 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-17131ad6-0cf1-497a-8586-a696c7321bc5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:35.982427 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-17131ad6-0cf1-497a-8586-a696c7321bc5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1755 microversion: 2.1 time: 0.160640 Aug 12 11:53:35.983021 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 283/559] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:35 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:36.442852 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-0af7676e-f6d4-4764-81fd-5923afa94822 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:36.443386 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-0af7676e-f6d4-4764-81fd-5923afa94822 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:36.449254 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0af7676e-f6d4-4764-81fd-5923afa94822 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:36.449733 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0af7676e-f6d4-4764-81fd-5923afa94822 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:36.450171 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0af7676e-f6d4-4764-81fd-5923afa94822 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:36.450886 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0af7676e-f6d4-4764-81fd-5923afa94822 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:36.451339 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0af7676e-f6d4-4764-81fd-5923afa94822 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:36.451762 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0af7676e-f6d4-4764-81fd-5923afa94822 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:36.679355 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-0af7676e-f6d4-4764-81fd-5923afa94822 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:36.685514 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-c88d6032-8c34-442c-b1a8-bcc503324b97 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:36.686313 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-c88d6032-8c34-442c-b1a8-bcc503324b97 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:36.687796 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-0af7676e-f6d4-4764-81fd-5923afa94822 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1656 microversion: 2.1 time: 0.248891 Aug 12 11:53:36.688648 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 277/560] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:36 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1656 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:36.693070 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c88d6032-8c34-442c-b1a8-bcc503324b97 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:36.693561 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c88d6032-8c34-442c-b1a8-bcc503324b97 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:36.694066 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c88d6032-8c34-442c-b1a8-bcc503324b97 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:36.694800 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c88d6032-8c34-442c-b1a8-bcc503324b97 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:36.695246 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c88d6032-8c34-442c-b1a8-bcc503324b97 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:36.695668 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c88d6032-8c34-442c-b1a8-bcc503324b97 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:36.708379 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-94a7772d-d38e-4b6e-bd04-e1bbb46bfaec tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:53:36.714375 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-94a7772d-d38e-4b6e-bd04-e1bbb46bfaec tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:36.714876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-94a7772d-d38e-4b6e-bd04-e1bbb46bfaec tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:36.715305 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-94a7772d-d38e-4b6e-bd04-e1bbb46bfaec tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:36.739798 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-94a7772d-d38e-4b6e-bd04-e1bbb46bfaec tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Going to try to start instance {{(pid=132282) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 12 11:53:36.783351 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-94a7772d-d38e-4b6e-bd04-e1bbb46bfaec tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "POST /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db/action" status: 202 len: 0 microversion: 2.1 time: 0.078460 Aug 12 11:53:36.784070 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 278/561] 10.222.0.42 () {60 vars in 1278 bytes} [Fri Aug 12 11:53:36 2022] POST /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 12 11:53:36.792272 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-2a7b9633-2545-48e6-b74d-f7822c2546df tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:36.793053 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-2a7b9633-2545-48e6-b74d-f7822c2546df tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:36.799358 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2a7b9633-2545-48e6-b74d-f7822c2546df tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:36.799962 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2a7b9633-2545-48e6-b74d-f7822c2546df tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:36.800372 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2a7b9633-2545-48e6-b74d-f7822c2546df tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:36.801250 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2a7b9633-2545-48e6-b74d-f7822c2546df tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:36.801780 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2a7b9633-2545-48e6-b74d-f7822c2546df tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:36.802262 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2a7b9633-2545-48e6-b74d-f7822c2546df tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:37.001575 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-c88d6032-8c34-442c-b1a8-bcc503324b97 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:37.009176 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-c88d6032-8c34-442c-b1a8-bcc503324b97 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1682 microversion: 2.1 time: 0.327790 Aug 12 11:53:37.009772 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 284/562] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:36 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1682 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:53:37.015981 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-6978a53d-7594-49ed-b9f0-fc0a730de4af tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:37.016597 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-6978a53d-7594-49ed-b9f0-fc0a730de4af tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:37.027828 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6978a53d-7594-49ed-b9f0-fc0a730de4af tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:37.028311 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6978a53d-7594-49ed-b9f0-fc0a730de4af tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:37.029502 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6978a53d-7594-49ed-b9f0-fc0a730de4af tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:37.030719 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6978a53d-7594-49ed-b9f0-fc0a730de4af tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:37.031522 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6978a53d-7594-49ed-b9f0-fc0a730de4af tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:37.032253 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6978a53d-7594-49ed-b9f0-fc0a730de4af tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:37.098977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-2a7b9633-2545-48e6-b74d-f7822c2546df tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:37.106406 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-2a7b9633-2545-48e6-b74d-f7822c2546df tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1665 microversion: 2.1 time: 0.318002 Aug 12 11:53:37.107007 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 279/563] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:36 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1665 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:53:37.290300 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-6978a53d-7594-49ed-b9f0-fc0a730de4af tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:37.299130 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-6978a53d-7594-49ed-b9f0-fc0a730de4af tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1755 microversion: 2.1 time: 0.287462 Aug 12 11:53:37.299778 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 285/564] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:37 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1755 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:38.016322 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-e3c1cf38-e272-4939-82e0-8e094cffc659 req-2d20855d-4148-460a-b7f5-7d688064f5b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ed98fc-5acc-42ec-9b95-86fc33117c65", "name": "network-vif-deleted", "tag": "4dbda732-75b7-4922-aed4-c2911cb6c8b5"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:53:38.029408 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-e3c1cf38-e272-4939-82e0-8e094cffc659 req-2d20855d-4148-460a-b7f5-7d688064f5b1 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:38.030328 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-e3c1cf38-e272-4939-82e0-8e094cffc659 req-2d20855d-4148-460a-b7f5-7d688064f5b1 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:38.031745 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-e3c1cf38-e272-4939-82e0-8e094cffc659 req-2d20855d-4148-460a-b7f5-7d688064f5b1 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:38.032689 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-9e1219fb-7863-4a13-b962-2842ac73bb6f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:38.033887 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-9e1219fb-7863-4a13-b962-2842ac73bb6f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:38.048505 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-e3c1cf38-e272-4939-82e0-8e094cffc659 req-2d20855d-4148-460a-b7f5-7d688064f5b1 service nova] Creating event network-vif-deleted:4dbda732-75b7-4922-aed4-c2911cb6c8b5 for instance d4ed98fc-5acc-42ec-9b95-86fc33117c65 on hv-cinder-85282 Aug 12 11:53:38.052311 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9e1219fb-7863-4a13-b962-2842ac73bb6f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:38.053394 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9e1219fb-7863-4a13-b962-2842ac73bb6f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:38.054335 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9e1219fb-7863-4a13-b962-2842ac73bb6f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:38.055709 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9e1219fb-7863-4a13-b962-2842ac73bb6f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:38.055974 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-e3c1cf38-e272-4939-82e0-8e094cffc659 req-2d20855d-4148-460a-b7f5-7d688064f5b1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043062 Aug 12 11:53:38.056625 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9e1219fb-7863-4a13-b962-2842ac73bb6f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:38.057055 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 280/565] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:53:38.060284 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9e1219fb-7863-4a13-b962-2842ac73bb6f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:38.129654 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-5143ab01-e927-474b-b581-a52e3ea378b0 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:38.130860 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-5143ab01-e927-474b-b581-a52e3ea378b0 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:38.145417 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-9e1219fb-7863-4a13-b962-2842ac73bb6f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:38.146382 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5143ab01-e927-474b-b581-a52e3ea378b0 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:38.150117 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5143ab01-e927-474b-b581-a52e3ea378b0 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:38.150821 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5143ab01-e927-474b-b581-a52e3ea378b0 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:38.151496 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5143ab01-e927-474b-b581-a52e3ea378b0 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:38.152029 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5143ab01-e927-474b-b581-a52e3ea378b0 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:38.158290 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5143ab01-e927-474b-b581-a52e3ea378b0 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:38.174707 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-9e1219fb-7863-4a13-b962-2842ac73bb6f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1326 microversion: 2.1 time: 0.142505 Aug 12 11:53:38.176358 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 286/566] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:38 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1326 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:38.313095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-5143ab01-e927-474b-b581-a52e3ea378b0 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:38.321977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-5143ab01-e927-474b-b581-a52e3ea378b0 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1665 microversion: 2.1 time: 0.197671 Aug 12 11:53:38.322311 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-aebdc874-d31f-47eb-a242-942cb4177570 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:38.323252 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-aebdc874-d31f-47eb-a242-942cb4177570 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:38.331746 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-aebdc874-d31f-47eb-a242-942cb4177570 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:38.332415 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-aebdc874-d31f-47eb-a242-942cb4177570 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:38.333010 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-aebdc874-d31f-47eb-a242-942cb4177570 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:38.333697 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-aebdc874-d31f-47eb-a242-942cb4177570 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:38.334303 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-aebdc874-d31f-47eb-a242-942cb4177570 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:38.334747 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-aebdc874-d31f-47eb-a242-942cb4177570 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:38.334969 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 281/567] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:38 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1665 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:38.478968 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-aebdc874-d31f-47eb-a242-942cb4177570 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:38.488402 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-aebdc874-d31f-47eb-a242-942cb4177570 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1755 microversion: 2.1 time: 0.170759 Aug 12 11:53:38.489237 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 287/568] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:38 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:53:39.197330 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-127078ce-f4f7-4ad3-96f6-c241fa550c27 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:39.197964 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-127078ce-f4f7-4ad3-96f6-c241fa550c27 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:39.204204 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-127078ce-f4f7-4ad3-96f6-c241fa550c27 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:39.204690 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-127078ce-f4f7-4ad3-96f6-c241fa550c27 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:39.205124 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-127078ce-f4f7-4ad3-96f6-c241fa550c27 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:39.205807 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-127078ce-f4f7-4ad3-96f6-c241fa550c27 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:39.206258 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-127078ce-f4f7-4ad3-96f6-c241fa550c27 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:39.206721 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-127078ce-f4f7-4ad3-96f6-c241fa550c27 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:39.237488 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-127078ce-f4f7-4ad3-96f6-c241fa550c27 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:39.237967 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-127078ce-f4f7-4ad3-96f6-c241fa550c27 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:39.238398 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-127078ce-f4f7-4ad3-96f6-c241fa550c27 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:39.238866 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.objects.instance [None req-127078ce-f4f7-4ad3-96f6-c241fa550c27 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lazy-loading 'fault' on Instance uuid d4ed98fc-5acc-42ec-9b95-86fc33117c65 {{(pid=132282) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:53:39.278585 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-127078ce-f4f7-4ad3-96f6-c241fa550c27 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:39.285818 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-127078ce-f4f7-4ad3-96f6-c241fa550c27 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 200 len: 1331 microversion: 2.1 time: 0.092443 Aug 12 11:53:39.286371 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 282/569] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:39 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 1331 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:39.343280 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-6db3cbc5-aba3-4fbf-836f-d57c4a35a43d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:39.343877 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-6db3cbc5-aba3-4fbf-836f-d57c4a35a43d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:39.350209 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6db3cbc5-aba3-4fbf-836f-d57c4a35a43d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:39.350718 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6db3cbc5-aba3-4fbf-836f-d57c4a35a43d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:39.351190 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6db3cbc5-aba3-4fbf-836f-d57c4a35a43d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:39.351868 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6db3cbc5-aba3-4fbf-836f-d57c4a35a43d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:39.352318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6db3cbc5-aba3-4fbf-836f-d57c4a35a43d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:39.352736 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6db3cbc5-aba3-4fbf-836f-d57c4a35a43d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:39.487401 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-6db3cbc5-aba3-4fbf-836f-d57c4a35a43d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:39.494857 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-6db3cbc5-aba3-4fbf-836f-d57c4a35a43d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1669 microversion: 2.1 time: 0.155898 Aug 12 11:53:39.495676 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 288/570] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:39 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:39.517331 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-40dd0f5a-6453-4555-bd5b-755bda82b46c tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:39.518061 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-40dd0f5a-6453-4555-bd5b-755bda82b46c tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:39.524646 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-40dd0f5a-6453-4555-bd5b-755bda82b46c tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:39.525185 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-40dd0f5a-6453-4555-bd5b-755bda82b46c tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:39.525653 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-40dd0f5a-6453-4555-bd5b-755bda82b46c tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:39.526428 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-40dd0f5a-6453-4555-bd5b-755bda82b46c tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:39.526992 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-40dd0f5a-6453-4555-bd5b-755bda82b46c tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:39.527726 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-40dd0f5a-6453-4555-bd5b-755bda82b46c tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:39.669670 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-40dd0f5a-6453-4555-bd5b-755bda82b46c tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:39.677980 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-40dd0f5a-6453-4555-bd5b-755bda82b46c tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1755 microversion: 2.1 time: 0.165295 Aug 12 11:53:39.678537 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 283/571] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:39 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:40.307103 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-0486078a-e1d0-4e9e-a218-2282ca526714 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:40.307710 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-0486078a-e1d0-4e9e-a218-2282ca526714 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:40.314413 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0486078a-e1d0-4e9e-a218-2282ca526714 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:40.314924 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0486078a-e1d0-4e9e-a218-2282ca526714 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:40.315350 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0486078a-e1d0-4e9e-a218-2282ca526714 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:40.316025 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0486078a-e1d0-4e9e-a218-2282ca526714 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:40.316466 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0486078a-e1d0-4e9e-a218-2282ca526714 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:40.316917 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0486078a-e1d0-4e9e-a218-2282ca526714 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:40.330296 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.wsgi [None req-0486078a-e1d0-4e9e-a218-2282ca526714 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] HTTP exception thrown: Instance d4ed98fc-5acc-42ec-9b95-86fc33117c65 could not be found. Aug 12 11:53:40.331909 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-0486078a-e1d0-4e9e-a218-2282ca526714 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Request method failure captured: Aug 12 11:53:40.331909 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 HTTP/1.1 Aug 12 11:53:40.331909 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 11:53:40.331909 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 11:53:40.331909 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 11:53:40.331909 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 0 Aug 12 11:53:40.331909 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 11:53:40.331909 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 11:53:40.331909 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 11:53:40.331909 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 11:53:40.331909 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9j5b93D9DFn6geUGIXSqCWNPRsOoFCQh7K0YJu6U1z8M-82hV_MMW-0Rx_RsrS3lVH4yCHqvGV-EIGSy6uHXvN26xND935rxaQQze8S1cibmQ_P5YQQSOUKlcTJjvmH8tXnzK6aYRsotianp-i1gOUOwU_1_GVtqTppajmycDWrHY6k Aug 12 11:53:40.331909 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 11:53:40.331909 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 11:53:40.331909 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 11:53:40.331909 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 11:53:40.331909 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 11:53:40.331909 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 11:53:40.331909 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: 8299891a8d134af4be3f84cdc7abec51 Aug 12 11:53:40.331909 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:53:40.331909 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 11:53:40.331909 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 11:53:40.333407 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8299891a8d134af4be3f84cdc7abec51", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8299891a8d134af4be3f84cdc7abec51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8299891a8d134af4be3f84cdc7abec51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8299891a8d134af4be3f84cdc7abec51"}]}] Aug 12 11:53:40.333407 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:53:40.333407 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: 8299891a8d134af4be3f84cdc7abec51 Aug 12 11:53:40.333407 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:53:40.333407 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-AttachVolumeNegativeTest-1716385367-project Aug 12 11:53:40.333407 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 11:53:40.333407 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 11:53:40.333407 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: 72a30400dec14a85889af8d8dd59886e Aug 12 11:53:40.333407 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-AttachVolumeNegativeTest-1716385367-project Aug 12 11:53:40.333407 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: > Aug 12 11:53:40.333407 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Instance d4ed98fc-5acc-42ec-9b95-86fc33117c65 could not be found. Aug 12 11:53:40.333407 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'id': 'd4ed98fc-5acc-42ec-9b95-86fc33117c65'} Aug 12 11:53:40.334270 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:53:40.334270 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:53:40.334270 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:53:40.334270 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:53:40.334270 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:53:40.334270 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:53:40.334270 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:53:40.334270 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:53:40.334270 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:53:40.334270 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:53:40.334270 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4ed98fc-5acc-42ec-9b95-86fc33117c65 could not be found. Aug 12 11:53:40.334270 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:53:40.334270 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:53:40.334270 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:53:40.334270 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:53:40.334270 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:53:40.334270 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:53:40.334270 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:53:40.334270 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:53:40.334270 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:53:40.335630 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:53:40.335630 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:53:40.335630 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:53:40.335630 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:53:40.335630 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:53:40.335630 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:53:40.335630 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:53:40.335630 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4ed98fc-5acc-42ec-9b95-86fc33117c65 could not be found. Aug 12 11:53:40.335630 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:53:40.335630 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:53:40.335630 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:53:40.335630 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:53:40.335630 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:53:40.335630 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:53:40.335630 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:53:40.335630 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:53:40.335630 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4ed98fc-5acc-42ec-9b95-86fc33117c65 could not be found. Aug 12 11:53:40.335630 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:53:40.336878 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-0486078a-e1d0-4e9e-a218-2282ca526714 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Returning 404 to user: Instance d4ed98fc-5acc-42ec-9b95-86fc33117c65 could not be found. {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:53:40.336878 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-0486078a-e1d0-4e9e-a218-2282ca526714 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 404 len: 111 microversion: 2.1 time: 0.029978 Aug 12 11:53:40.336878 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 289/572] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:40 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:53:40.341978 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-f20a3d7f-165f-4fc6-9887-a454fc64cfbc tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '.version_select at 0x7f3e583cd4c0>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:40.360206 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-f20a3d7f-165f-4fc6-9887-a454fc64cfbc tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1102741577" status: 202 len: 0 microversion: 2.1 time: 0.021892 Aug 12 11:53:40.360757 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 284/573] 10.222.0.42 () {58 vars in 1221 bytes} [Fri Aug 12 11:53:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1102741577 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:53:40.699567 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-537971f2-e579-4cdb-beee-b8ff31d968ca tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:40.700191 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-537971f2-e579-4cdb-beee-b8ff31d968ca tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:40.702803 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:53:40.707966 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-537971f2-e579-4cdb-beee-b8ff31d968ca tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:40.708474 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-537971f2-e579-4cdb-beee-b8ff31d968ca tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:40.708904 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-537971f2-e579-4cdb-beee-b8ff31d968ca tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:40.709592 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-537971f2-e579-4cdb-beee-b8ff31d968ca tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:40.710041 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-537971f2-e579-4cdb-beee-b8ff31d968ca tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:40.710489 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-537971f2-e579-4cdb-beee-b8ff31d968ca tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:40.926473 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-537971f2-e579-4cdb-beee-b8ff31d968ca tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:40.935209 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-537971f2-e579-4cdb-beee-b8ff31d968ca tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1755 microversion: 2.1 time: 0.239129 Aug 12 11:53:40.935553 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 290/574] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:40 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1755 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:41.061696 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-815e3a41-375f-4d15-a4d7-5385b345b641 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Action: 'create', calling method: .version_select at 0x7f3e5831aca0>, body: {"keypair": {"name": "tempest-keypair-952718840", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPJZJVpriuPjoAC6kgJQNPkAJq1txGdaeBLXjXkK9zyFkbUi0y5giBSc6qdaydZlG4gZawOiF/hAqcHxQ79F4RNNrz+3ZvrH1oRvmkr/eqldUsg6CPKL6sBYJhEcUdl4w=="}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:53:41.077456 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-815e3a41-375f-4d15-a4d7-5385b345b641 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Getting quotas for project 8299891a8d134af4be3f84cdc7abec51. Resources: {'key_pairs'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:53:41.081236 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-815e3a41-375f-4d15-a4d7-5385b345b641 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Getting quotas for user 72a30400dec14a85889af8d8dd59886e and project 8299891a8d134af4be3f84cdc7abec51. Resources: {'key_pairs'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:53:41.103269 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-815e3a41-375f-4d15-a4d7-5385b345b641 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045707 Aug 12 11:53:41.103854 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 285/575] 10.222.0.42 () {60 vars in 1159 bytes} [Fri Aug 12 11:53:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:53:41.956258 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-94dffa7a-a9ad-4a66-adae-1b81300ea0ae tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:41.956968 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-94dffa7a-a9ad-4a66-adae-1b81300ea0ae tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:41.963843 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-94dffa7a-a9ad-4a66-adae-1b81300ea0ae tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:41.964326 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-94dffa7a-a9ad-4a66-adae-1b81300ea0ae tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:41.964775 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-94dffa7a-a9ad-4a66-adae-1b81300ea0ae tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:41.965443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-94dffa7a-a9ad-4a66-adae-1b81300ea0ae tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:41.965892 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-94dffa7a-a9ad-4a66-adae-1b81300ea0ae tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:41.966310 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-94dffa7a-a9ad-4a66-adae-1b81300ea0ae tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:42.112296 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-94dffa7a-a9ad-4a66-adae-1b81300ea0ae tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:42.123237 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-94dffa7a-a9ad-4a66-adae-1b81300ea0ae tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1755 microversion: 2.1 time: 0.170328 Aug 12 11:53:42.123984 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 291/576] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:41 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:42.323282 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d5213f52-dc0b-4f71-bb84-c0dcab21118e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1881361080", "imageRef": "2887ca5b-6aa2-4cc4-a2be-9322a733fc6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7833e310-6d60-47b5-8e0a-4784db7aa59d"}], "security_groups": [{"name": "tempest-securitygroup--1507865051"}], "key_name": "tempest-keypair-952718840", "user_data": "}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:53:42.424381 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.network.neutron [None req-d5213f52-dc0b-4f71-bb84-c0dcab21118e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] validate_networks() for [('7833e310-6d60-47b5-8e0a-4784db7aa59d', None, None, None, None, None)] {{(pid=132282) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 11:53:42.779306 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-d5213f52-dc0b-4f71-bb84-c0dcab21118e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Flavor limits 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 11:53:42.779726 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-d5213f52-dc0b-4f71-bb84-c0dcab21118e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Image limits 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 11:53:42.780195 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-d5213f52-dc0b-4f71-bb84-c0dcab21118e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Flavor pref 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 11:53:42.780598 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-d5213f52-dc0b-4f71-bb84-c0dcab21118e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Image pref 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 11:53:42.781004 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-d5213f52-dc0b-4f71-bb84-c0dcab21118e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 11:53:42.789655 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d5213f52-dc0b-4f71-bb84-c0dcab21118e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:42.790130 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d5213f52-dc0b-4f71-bb84-c0dcab21118e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:42.790561 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d5213f52-dc0b-4f71-bb84-c0dcab21118e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:42.791316 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d5213f52-dc0b-4f71-bb84-c0dcab21118e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:42.791763 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d5213f52-dc0b-4f71-bb84-c0dcab21118e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:42.792184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d5213f52-dc0b-4f71-bb84-c0dcab21118e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:42.808316 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-d5213f52-dc0b-4f71-bb84-c0dcab21118e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Getting quotas for project 8299891a8d134af4be3f84cdc7abec51. Resources: {'instances', 'ram', 'cores'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:53:42.812454 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-d5213f52-dc0b-4f71-bb84-c0dcab21118e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Getting quotas for user 72a30400dec14a85889af8d8dd59886e and project 8299891a8d134af4be3f84cdc7abec51. Resources: {'instances', 'ram', 'cores'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:53:42.823416 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d5213f52-dc0b-4f71-bb84-c0dcab21118e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Going to run 1 instances... {{(pid=132282) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 11:53:42.826147 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d5213f52-dc0b-4f71-bb84-c0dcab21118e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: e6216214-8daa-47dc-88aa-c9af7a623f64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2887ca5b-6aa2-4cc4-a2be-9322a733fc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132282) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 11:53:42.872039 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-d5213f52-dc0b-4f71-bb84-c0dcab21118e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.553068 Aug 12 11:53:42.872865 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 286/577] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Aug 12 11:53:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 11:53:42.883228 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-233e71f4-3098-42d3-bbb0-0a0724ac54a9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:42.883828 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-233e71f4-3098-42d3-bbb0-0a0724ac54a9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: e6216214-8daa-47dc-88aa-c9af7a623f64] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:42.935998 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-233e71f4-3098-42d3-bbb0-0a0724ac54a9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:42.942686 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-233e71f4-3098-42d3-bbb0-0a0724ac54a9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64" status: 200 len: 1241 microversion: 2.1 time: 0.063161 Aug 12 11:53:42.943249 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 292/578] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:42 2022] GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64 => generated 1241 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:43.146135 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-fe85c6a5-e175-425d-99be-270a5930eb47 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:43.146946 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-fe85c6a5-e175-425d-99be-270a5930eb47 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:43.153051 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fe85c6a5-e175-425d-99be-270a5930eb47 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:43.153536 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fe85c6a5-e175-425d-99be-270a5930eb47 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:43.153989 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fe85c6a5-e175-425d-99be-270a5930eb47 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:43.155090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fe85c6a5-e175-425d-99be-270a5930eb47 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:43.155419 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fe85c6a5-e175-425d-99be-270a5930eb47 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:43.155847 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fe85c6a5-e175-425d-99be-270a5930eb47 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:43.311777 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-fe85c6a5-e175-425d-99be-270a5930eb47 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:43.319907 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-fe85c6a5-e175-425d-99be-270a5930eb47 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1755 microversion: 2.1 time: 0.178116 Aug 12 11:53:43.320649 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 287/579] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:43 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:43.964262 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-d5a8632c-642d-4e4b-ab4f-4ee09f9dbb4c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:43.964885 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-d5a8632c-642d-4e4b-ab4f-4ee09f9dbb4c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: e6216214-8daa-47dc-88aa-c9af7a623f64] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:43.972074 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d5a8632c-642d-4e4b-ab4f-4ee09f9dbb4c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:43.972638 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d5a8632c-642d-4e4b-ab4f-4ee09f9dbb4c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:43.973300 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d5a8632c-642d-4e4b-ab4f-4ee09f9dbb4c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:43.974001 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d5a8632c-642d-4e4b-ab4f-4ee09f9dbb4c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:43.974456 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d5a8632c-642d-4e4b-ab4f-4ee09f9dbb4c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:43.974912 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d5a8632c-642d-4e4b-ab4f-4ee09f9dbb4c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:43.998076 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:53:44.061288 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-d5a8632c-642d-4e4b-ab4f-4ee09f9dbb4c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:44.069526 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-d5a8632c-642d-4e4b-ab4f-4ee09f9dbb4c tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64" status: 200 len: 1301 microversion: 2.1 time: 0.109299 Aug 12 11:53:44.070092 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 293/580] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:43 2022] GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64 => generated 1301 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:44.342010 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-df40a6f6-6586-48da-8365-17ca36bbcee1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:44.342663 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-df40a6f6-6586-48da-8365-17ca36bbcee1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:44.349381 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-df40a6f6-6586-48da-8365-17ca36bbcee1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:44.349854 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-df40a6f6-6586-48da-8365-17ca36bbcee1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:44.350288 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-df40a6f6-6586-48da-8365-17ca36bbcee1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:44.351019 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-df40a6f6-6586-48da-8365-17ca36bbcee1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:44.351463 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-df40a6f6-6586-48da-8365-17ca36bbcee1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:44.351882 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-df40a6f6-6586-48da-8365-17ca36bbcee1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:44.582384 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-df40a6f6-6586-48da-8365-17ca36bbcee1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:44.590470 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-df40a6f6-6586-48da-8365-17ca36bbcee1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1755 microversion: 2.1 time: 0.253013 Aug 12 11:53:44.591280 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 288/581] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:44 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1755 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:45.091741 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-60dc77bb-e5f4-4e7c-bf5a-779af278df83 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:45.092261 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-60dc77bb-e5f4-4e7c-bf5a-779af278df83 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: e6216214-8daa-47dc-88aa-c9af7a623f64] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:45.099625 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-60dc77bb-e5f4-4e7c-bf5a-779af278df83 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:45.100121 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-60dc77bb-e5f4-4e7c-bf5a-779af278df83 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:45.100559 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-60dc77bb-e5f4-4e7c-bf5a-779af278df83 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:45.101255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-60dc77bb-e5f4-4e7c-bf5a-779af278df83 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:45.101710 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-60dc77bb-e5f4-4e7c-bf5a-779af278df83 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:45.102135 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-60dc77bb-e5f4-4e7c-bf5a-779af278df83 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:45.299998 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-60dc77bb-e5f4-4e7c-bf5a-779af278df83 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:45.307487 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-60dc77bb-e5f4-4e7c-bf5a-779af278df83 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64" status: 200 len: 1367 microversion: 2.1 time: 0.219661 Aug 12 11:53:45.308047 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 294/582] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:45 2022] GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:45.536728 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-fc368133-eb1c-4d9d-bd4f-53474160a43a req-e047ae15-77db-46e7-b216-1cae66c641f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6216214-8daa-47dc-88aa-c9af7a623f64", "tag": "de15eac7-57e7-484d-9446-6737d3a47b8d"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:53:45.547254 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-fc368133-eb1c-4d9d-bd4f-53474160a43a req-e047ae15-77db-46e7-b216-1cae66c641f6 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:45.547735 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-fc368133-eb1c-4d9d-bd4f-53474160a43a req-e047ae15-77db-46e7-b216-1cae66c641f6 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:45.548168 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-fc368133-eb1c-4d9d-bd4f-53474160a43a req-e047ae15-77db-46e7-b216-1cae66c641f6 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:45.559825 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-fc368133-eb1c-4d9d-bd4f-53474160a43a req-e047ae15-77db-46e7-b216-1cae66c641f6 service nova] Creating event network-changed:de15eac7-57e7-484d-9446-6737d3a47b8d for instance e6216214-8daa-47dc-88aa-c9af7a623f64 on hv-cinder-85282 Aug 12 11:53:45.564694 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-fc368133-eb1c-4d9d-bd4f-53474160a43a req-e047ae15-77db-46e7-b216-1cae66c641f6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031608 Aug 12 11:53:45.565287 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 289/583] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:53:45.612531 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-2d236f2b-59c3-4d0e-904f-a23223881d6f tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:45.613399 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-2d236f2b-59c3-4d0e-904f-a23223881d6f tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:45.619785 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2d236f2b-59c3-4d0e-904f-a23223881d6f tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:45.620267 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2d236f2b-59c3-4d0e-904f-a23223881d6f tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:45.620702 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2d236f2b-59c3-4d0e-904f-a23223881d6f tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:45.621397 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2d236f2b-59c3-4d0e-904f-a23223881d6f tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:45.621851 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2d236f2b-59c3-4d0e-904f-a23223881d6f tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:45.622288 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2d236f2b-59c3-4d0e-904f-a23223881d6f tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:45.860256 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-2d236f2b-59c3-4d0e-904f-a23223881d6f tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:45.870747 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-2d236f2b-59c3-4d0e-904f-a23223881d6f tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1755 microversion: 2.1 time: 0.262792 Aug 12 11:53:45.871318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 295/584] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:45 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1755 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:46.330094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d3101722-ee06-46ad-b61e-cbb4a853cda9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:46.330735 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d3101722-ee06-46ad-b61e-cbb4a853cda9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: e6216214-8daa-47dc-88aa-c9af7a623f64] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:46.336780 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d3101722-ee06-46ad-b61e-cbb4a853cda9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:46.337260 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d3101722-ee06-46ad-b61e-cbb4a853cda9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:46.337695 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d3101722-ee06-46ad-b61e-cbb4a853cda9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:46.338407 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d3101722-ee06-46ad-b61e-cbb4a853cda9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:46.338900 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d3101722-ee06-46ad-b61e-cbb4a853cda9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:46.339325 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d3101722-ee06-46ad-b61e-cbb4a853cda9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:46.465017 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d3101722-ee06-46ad-b61e-cbb4a853cda9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:46.472415 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-d3101722-ee06-46ad-b61e-cbb4a853cda9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64" status: 200 len: 1367 microversion: 2.1 time: 0.147197 Aug 12 11:53:46.472952 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 290/585] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:46 2022] GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:46.891811 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-3907989e-7168-473a-9742-f4649a4fcd8a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:46.892421 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-3907989e-7168-473a-9742-f4649a4fcd8a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:46.899009 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3907989e-7168-473a-9742-f4649a4fcd8a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:46.899488 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3907989e-7168-473a-9742-f4649a4fcd8a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:46.899915 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3907989e-7168-473a-9742-f4649a4fcd8a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:46.900594 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3907989e-7168-473a-9742-f4649a4fcd8a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:46.901045 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3907989e-7168-473a-9742-f4649a4fcd8a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:46.901459 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3907989e-7168-473a-9742-f4649a4fcd8a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:47.038710 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-3907989e-7168-473a-9742-f4649a4fcd8a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:47.047035 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-3907989e-7168-473a-9742-f4649a4fcd8a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1755 microversion: 2.1 time: 0.159049 Aug 12 11:53:47.047590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 296/586] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:46 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:47.493588 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-320368ce-7699-4b48-9465-f28cbc97eecb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:47.494778 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-320368ce-7699-4b48-9465-f28cbc97eecb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: e6216214-8daa-47dc-88aa-c9af7a623f64] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:47.501180 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-320368ce-7699-4b48-9465-f28cbc97eecb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:47.501666 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-320368ce-7699-4b48-9465-f28cbc97eecb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:47.502107 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-320368ce-7699-4b48-9465-f28cbc97eecb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:47.502826 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-320368ce-7699-4b48-9465-f28cbc97eecb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:47.503285 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-320368ce-7699-4b48-9465-f28cbc97eecb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:47.503713 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-320368ce-7699-4b48-9465-f28cbc97eecb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:47.715906 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-320368ce-7699-4b48-9465-f28cbc97eecb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:47.719431 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:53:47.723872 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-320368ce-7699-4b48-9465-f28cbc97eecb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64" status: 200 len: 1367 microversion: 2.1 time: 0.234184 Aug 12 11:53:47.724781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 291/587] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:47 2022] GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:48.068202 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-6a21daa1-d1fb-455a-8e05-237c24df37ad tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:48.068821 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-6a21daa1-d1fb-455a-8e05-237c24df37ad tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:48.075219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6a21daa1-d1fb-455a-8e05-237c24df37ad tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:48.075697 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6a21daa1-d1fb-455a-8e05-237c24df37ad tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:48.076134 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6a21daa1-d1fb-455a-8e05-237c24df37ad tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:48.076822 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6a21daa1-d1fb-455a-8e05-237c24df37ad tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:48.077277 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6a21daa1-d1fb-455a-8e05-237c24df37ad tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:48.077701 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6a21daa1-d1fb-455a-8e05-237c24df37ad tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:48.220138 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-6a21daa1-d1fb-455a-8e05-237c24df37ad tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:48.231199 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-6a21daa1-d1fb-455a-8e05-237c24df37ad tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1755 microversion: 2.1 time: 0.166425 Aug 12 11:53:48.232672 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 297/588] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:48 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:48.745130 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-7fb047ab-6976-4c63-9ee3-8edcbe04e4cf tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:48.745639 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-7fb047ab-6976-4c63-9ee3-8edcbe04e4cf tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: e6216214-8daa-47dc-88aa-c9af7a623f64] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:48.752785 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7fb047ab-6976-4c63-9ee3-8edcbe04e4cf tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:48.753266 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7fb047ab-6976-4c63-9ee3-8edcbe04e4cf tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:48.753701 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7fb047ab-6976-4c63-9ee3-8edcbe04e4cf tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:48.754390 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7fb047ab-6976-4c63-9ee3-8edcbe04e4cf tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:48.754885 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7fb047ab-6976-4c63-9ee3-8edcbe04e4cf tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:48.755308 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7fb047ab-6976-4c63-9ee3-8edcbe04e4cf tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:48.885589 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-7fb047ab-6976-4c63-9ee3-8edcbe04e4cf tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:48.893425 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-7fb047ab-6976-4c63-9ee3-8edcbe04e4cf tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64" status: 200 len: 1367 microversion: 2.1 time: 0.152570 Aug 12 11:53:48.893988 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 292/589] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:48 2022] GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:49.253473 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-d4b78230-74eb-4f29-81d6-69546e2b633a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:49.254086 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-d4b78230-74eb-4f29-81d6-69546e2b633a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:49.261726 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d4b78230-74eb-4f29-81d6-69546e2b633a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:49.262212 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d4b78230-74eb-4f29-81d6-69546e2b633a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:49.262666 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d4b78230-74eb-4f29-81d6-69546e2b633a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:49.264022 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d4b78230-74eb-4f29-81d6-69546e2b633a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:49.264474 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d4b78230-74eb-4f29-81d6-69546e2b633a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:49.264900 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d4b78230-74eb-4f29-81d6-69546e2b633a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:49.365869 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-52cdf6f7-be18-42d7-81f6-f691a338723c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fde48ed1-a110-4ae9-a30b-fc5f73625c30"}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:53:49.368343 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-52cdf6f7-be18-42d7-81f6-f691a338723c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:49.374679 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-52cdf6f7-be18-42d7-81f6-f691a338723c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:49.375153 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-52cdf6f7-be18-42d7-81f6-f691a338723c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:49.375582 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-52cdf6f7-be18-42d7-81f6-f691a338723c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:49.376263 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-52cdf6f7-be18-42d7-81f6-f691a338723c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:49.376708 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-52cdf6f7-be18-42d7-81f6-f691a338723c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:49.377129 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-52cdf6f7-be18-42d7-81f6-f691a338723c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:49.441929 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-d4b78230-74eb-4f29-81d6-69546e2b633a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:49.449981 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-d4b78230-74eb-4f29-81d6-69546e2b633a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1758 microversion: 2.1 time: 0.200246 Aug 12 11:53:49.450647 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 298/590] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:49 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1758 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:49.658636 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-52cdf6f7-be18-42d7-81f6-f691a338723c tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "POST /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296496 Aug 12 11:53:49.664779 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 293/591] 10.222.0.42 () {60 vars in 1323 bytes} [Fri Aug 12 11:53:49 2022] POST /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:53:49.917311 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-f93d1197-6178-4bea-8ab7-2e7e3da8b01e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:49.918191 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-f93d1197-6178-4bea-8ab7-2e7e3da8b01e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: e6216214-8daa-47dc-88aa-c9af7a623f64] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:49.925951 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f93d1197-6178-4bea-8ab7-2e7e3da8b01e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:49.926449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f93d1197-6178-4bea-8ab7-2e7e3da8b01e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:49.926910 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f93d1197-6178-4bea-8ab7-2e7e3da8b01e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:49.928029 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f93d1197-6178-4bea-8ab7-2e7e3da8b01e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:49.928121 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f93d1197-6178-4bea-8ab7-2e7e3da8b01e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:49.928807 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f93d1197-6178-4bea-8ab7-2e7e3da8b01e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:50.129655 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-f93d1197-6178-4bea-8ab7-2e7e3da8b01e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:50.138146 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-f93d1197-6178-4bea-8ab7-2e7e3da8b01e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64" status: 200 len: 1367 microversion: 2.1 time: 0.226661 Aug 12 11:53:50.138769 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 299/592] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:49 2022] GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:53:51.159805 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-2d3f8c1a-f1c6-48aa-aaaf-c50d9e1a5c2a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:51.160411 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-2d3f8c1a-f1c6-48aa-aaaf-c50d9e1a5c2a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: e6216214-8daa-47dc-88aa-c9af7a623f64] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:51.166778 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2d3f8c1a-f1c6-48aa-aaaf-c50d9e1a5c2a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:51.167252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2d3f8c1a-f1c6-48aa-aaaf-c50d9e1a5c2a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:51.167675 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2d3f8c1a-f1c6-48aa-aaaf-c50d9e1a5c2a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:51.168352 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2d3f8c1a-f1c6-48aa-aaaf-c50d9e1a5c2a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:51.168831 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2d3f8c1a-f1c6-48aa-aaaf-c50d9e1a5c2a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:51.169783 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2d3f8c1a-f1c6-48aa-aaaf-c50d9e1a5c2a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:51.302997 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-2d3f8c1a-f1c6-48aa-aaaf-c50d9e1a5c2a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:51.311275 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-2d3f8c1a-f1c6-48aa-aaaf-c50d9e1a5c2a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64" status: 200 len: 1367 microversion: 2.1 time: 0.156193 Aug 12 11:53:51.311841 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 294/593] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:51 2022] GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:52.188701 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-e8bc5d41-1e78-4068-a1f8-df8cc71d332c req-e5702a01-bfd5-49b5-a4f9-d5b582c32ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6216214-8daa-47dc-88aa-c9af7a623f64", "name": "network-vif-plugged", "status": "completed", "tag": "de15eac7-57e7-484d-9446-6737d3a47b8d"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:53:52.198723 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-e8bc5d41-1e78-4068-a1f8-df8cc71d332c req-e5702a01-bfd5-49b5-a4f9-d5b582c32ca3 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:52.199203 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-e8bc5d41-1e78-4068-a1f8-df8cc71d332c req-e5702a01-bfd5-49b5-a4f9-d5b582c32ca3 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:52.199642 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-e8bc5d41-1e78-4068-a1f8-df8cc71d332c req-e5702a01-bfd5-49b5-a4f9-d5b582c32ca3 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:52.211398 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-e8bc5d41-1e78-4068-a1f8-df8cc71d332c req-e5702a01-bfd5-49b5-a4f9-d5b582c32ca3 service nova] Creating event network-vif-plugged:de15eac7-57e7-484d-9446-6737d3a47b8d for instance e6216214-8daa-47dc-88aa-c9af7a623f64 on hv-cinder-85282 Aug 12 11:53:52.216216 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-e8bc5d41-1e78-4068-a1f8-df8cc71d332c req-e5702a01-bfd5-49b5-a4f9-d5b582c32ca3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031706 Aug 12 11:53:52.216949 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 300/594] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:53:52.332045 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-83b95961-44e5-41be-afa1-195fbc4b3987 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:52.333272 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-83b95961-44e5-41be-afa1-195fbc4b3987 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: e6216214-8daa-47dc-88aa-c9af7a623f64] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:52.335687 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:53:52.340798 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-83b95961-44e5-41be-afa1-195fbc4b3987 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:52.341345 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-83b95961-44e5-41be-afa1-195fbc4b3987 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:52.342012 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-83b95961-44e5-41be-afa1-195fbc4b3987 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:52.342753 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-83b95961-44e5-41be-afa1-195fbc4b3987 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:52.343204 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-83b95961-44e5-41be-afa1-195fbc4b3987 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:52.343641 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-83b95961-44e5-41be-afa1-195fbc4b3987 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:52.530639 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-83b95961-44e5-41be-afa1-195fbc4b3987 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:52.538072 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-83b95961-44e5-41be-afa1-195fbc4b3987 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64" status: 200 len: 1367 microversion: 2.1 time: 0.209783 Aug 12 11:53:52.538657 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 295/595] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:52 2022] GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:53.558024 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell0:SELECT=2 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:53:53.564740 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-c456446c-c9d8-4672-bb53-7f811b985ac6 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:53.565436 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-c456446c-c9d8-4672-bb53-7f811b985ac6 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: e6216214-8daa-47dc-88aa-c9af7a623f64] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:53.576708 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c456446c-c9d8-4672-bb53-7f811b985ac6 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:53.577190 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c456446c-c9d8-4672-bb53-7f811b985ac6 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:53.577620 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c456446c-c9d8-4672-bb53-7f811b985ac6 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:53.578312 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c456446c-c9d8-4672-bb53-7f811b985ac6 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:53.578800 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c456446c-c9d8-4672-bb53-7f811b985ac6 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:53.579221 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c456446c-c9d8-4672-bb53-7f811b985ac6 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:53.715318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-c456446c-c9d8-4672-bb53-7f811b985ac6 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:53.722690 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-c456446c-c9d8-4672-bb53-7f811b985ac6 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64" status: 200 len: 1367 microversion: 2.1 time: 0.167084 Aug 12 11:53:53.723255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 301/596] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:53 2022] GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:54.743809 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-327f5247-045a-42c6-a7d2-44327906ff1a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:54.744418 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-327f5247-045a-42c6-a7d2-44327906ff1a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: e6216214-8daa-47dc-88aa-c9af7a623f64] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:54.746259 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=2 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:53:54.747026 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=10 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:53:54.753016 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-327f5247-045a-42c6-a7d2-44327906ff1a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:54.753495 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-327f5247-045a-42c6-a7d2-44327906ff1a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:54.753929 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-327f5247-045a-42c6-a7d2-44327906ff1a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:54.754646 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-327f5247-045a-42c6-a7d2-44327906ff1a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:54.755099 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-327f5247-045a-42c6-a7d2-44327906ff1a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:54.755519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-327f5247-045a-42c6-a7d2-44327906ff1a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:54.879962 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-327f5247-045a-42c6-a7d2-44327906ff1a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:54.887338 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-327f5247-045a-42c6-a7d2-44327906ff1a tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64" status: 200 len: 1558 microversion: 2.1 time: 0.147371 Aug 12 11:53:54.888392 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 296/597] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:54 2022] GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:54.908438 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-213cd23a-ddca-492a-9aea-ad8a852741ff tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:54.908955 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-213cd23a-ddca-492a-9aea-ad8a852741ff tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: e6216214-8daa-47dc-88aa-c9af7a623f64] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:54.915491 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-213cd23a-ddca-492a-9aea-ad8a852741ff tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:54.915964 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-213cd23a-ddca-492a-9aea-ad8a852741ff tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:54.916394 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-213cd23a-ddca-492a-9aea-ad8a852741ff tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:54.917066 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-213cd23a-ddca-492a-9aea-ad8a852741ff tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:54.917512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-213cd23a-ddca-492a-9aea-ad8a852741ff tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:54.917928 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-213cd23a-ddca-492a-9aea-ad8a852741ff tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:55.001516 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-213cd23a-ddca-492a-9aea-ad8a852741ff tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096766 Aug 12 11:53:55.002102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 302/598] 10.222.0.42 () {58 vars in 1275 bytes} [Fri Aug 12 11:53:54 2022] GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:53:55.911524 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-94f57755-64db-41c9-9976-122ef4a5aa8b req-114f4667-d62b-48a3-b1d7-ad05c13a7101 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6216214-8daa-47dc-88aa-c9af7a623f64", "tag": "de15eac7-57e7-484d-9446-6737d3a47b8d"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:53:55.922125 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-94f57755-64db-41c9-9976-122ef4a5aa8b req-114f4667-d62b-48a3-b1d7-ad05c13a7101 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:55.922625 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-94f57755-64db-41c9-9976-122ef4a5aa8b req-114f4667-d62b-48a3-b1d7-ad05c13a7101 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:55.923682 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-94f57755-64db-41c9-9976-122ef4a5aa8b req-114f4667-d62b-48a3-b1d7-ad05c13a7101 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:55.937472 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-94f57755-64db-41c9-9976-122ef4a5aa8b req-114f4667-d62b-48a3-b1d7-ad05c13a7101 service nova] Creating event network-changed:de15eac7-57e7-484d-9446-6737d3a47b8d for instance e6216214-8daa-47dc-88aa-c9af7a623f64 on hv-cinder-85282 Aug 12 11:53:55.942366 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-94f57755-64db-41c9-9976-122ef4a5aa8b req-114f4667-d62b-48a3-b1d7-ad05c13a7101 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034332 Aug 12 11:53:55.942995 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 297/599] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:53:57.184477 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-bc446413-b690-4c1f-9683-f6df3cf24bd8 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:53:57.187323 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-bc446413-b690-4c1f-9683-f6df3cf24bd8 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:57.193202 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bc446413-b690-4c1f-9683-f6df3cf24bd8 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:57.193681 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bc446413-b690-4c1f-9683-f6df3cf24bd8 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:57.194106 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bc446413-b690-4c1f-9683-f6df3cf24bd8 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:57.194826 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bc446413-b690-4c1f-9683-f6df3cf24bd8 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:57.195275 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bc446413-b690-4c1f-9683-f6df3cf24bd8 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:57.195691 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bc446413-b690-4c1f-9683-f6df3cf24bd8 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:57.217877 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.objects.instance [None req-bc446413-b690-4c1f-9683-f6df3cf24bd8 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lazy-loading 'flavor' on Instance uuid 7545dc36-2c18-434c-94e4-771977a58319 {{(pid=132281) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:53:57.342428 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-bc446413-b690-4c1f-9683-f6df3cf24bd8 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "POST /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319/action" status: 200 len: 32 microversion: 2.1 time: 0.162692 Aug 12 11:53:57.343076 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 303/600] 10.222.0.42 () {60 vars in 1278 bytes} [Fri Aug 12 11:53:57 2022] POST /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 11:53:57.353274 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-63aad56f-0b4d-4a1c-938a-5271dd4ba6b9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:57.353959 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-63aad56f-0b4d-4a1c-938a-5271dd4ba6b9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:57.360509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-63aad56f-0b4d-4a1c-938a-5271dd4ba6b9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:57.360984 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-63aad56f-0b4d-4a1c-938a-5271dd4ba6b9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:57.361413 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-63aad56f-0b4d-4a1c-938a-5271dd4ba6b9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:57.362099 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-63aad56f-0b4d-4a1c-938a-5271dd4ba6b9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:57.362664 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-63aad56f-0b4d-4a1c-938a-5271dd4ba6b9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:57.362996 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-63aad56f-0b4d-4a1c-938a-5271dd4ba6b9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:57.563221 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-63aad56f-0b4d-4a1c-938a-5271dd4ba6b9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:57.571101 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-63aad56f-0b4d-4a1c-938a-5271dd4ba6b9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1735 microversion: 2.1 time: 0.222382 Aug 12 11:53:57.571669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 298/601] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:57 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:53:58.593123 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-a7de2264-3a8c-4f04-b467-26a415e574f7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:58.593820 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-a7de2264-3a8c-4f04-b467-26a415e574f7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:58.599973 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a7de2264-3a8c-4f04-b467-26a415e574f7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:58.600450 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a7de2264-3a8c-4f04-b467-26a415e574f7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:58.600917 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a7de2264-3a8c-4f04-b467-26a415e574f7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:58.601596 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a7de2264-3a8c-4f04-b467-26a415e574f7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:58.602044 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a7de2264-3a8c-4f04-b467-26a415e574f7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:58.602462 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a7de2264-3a8c-4f04-b467-26a415e574f7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:58.731006 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-a7de2264-3a8c-4f04-b467-26a415e574f7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:58.739376 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-a7de2264-3a8c-4f04-b467-26a415e574f7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1735 microversion: 2.1 time: 0.150971 Aug 12 11:53:58.739940 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 304/602] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:58 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:53:59.761009 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-ec31fa08-d977-4a8b-9fc9-732fc4f46456 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:53:59.761640 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-ec31fa08-d977-4a8b-9fc9-732fc4f46456 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:53:59.768656 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ec31fa08-d977-4a8b-9fc9-732fc4f46456 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:59.769132 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ec31fa08-d977-4a8b-9fc9-732fc4f46456 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:59.769571 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ec31fa08-d977-4a8b-9fc9-732fc4f46456 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:59.770255 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ec31fa08-d977-4a8b-9fc9-732fc4f46456 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:53:59.770721 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ec31fa08-d977-4a8b-9fc9-732fc4f46456 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:53:59.771141 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ec31fa08-d977-4a8b-9fc9-732fc4f46456 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:53:59.898893 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-ec31fa08-d977-4a8b-9fc9-732fc4f46456 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:53:59.906822 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-ec31fa08-d977-4a8b-9fc9-732fc4f46456 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1735 microversion: 2.1 time: 0.149683 Aug 12 11:53:59.907371 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 299/603] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:53:59 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:00.930357 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-860aa45c-453f-4853-b3a6-4a2636b18718 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:00.931537 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-860aa45c-453f-4853-b3a6-4a2636b18718 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:00.938812 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-860aa45c-453f-4853-b3a6-4a2636b18718 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:00.939412 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-860aa45c-453f-4853-b3a6-4a2636b18718 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:00.939841 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-860aa45c-453f-4853-b3a6-4a2636b18718 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:00.940559 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-860aa45c-453f-4853-b3a6-4a2636b18718 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:00.941003 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-860aa45c-453f-4853-b3a6-4a2636b18718 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:00.941417 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-860aa45c-453f-4853-b3a6-4a2636b18718 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:01.067092 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-860aa45c-453f-4853-b3a6-4a2636b18718 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:01.074867 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-860aa45c-453f-4853-b3a6-4a2636b18718 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1735 microversion: 2.1 time: 0.149581 Aug 12 11:54:01.076071 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 305/604] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:00 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:02.096401 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-b9d76418-e121-42d0-aeaf-85912918cdab tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:02.096998 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-b9d76418-e121-42d0-aeaf-85912918cdab tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:02.103427 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b9d76418-e121-42d0-aeaf-85912918cdab tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:02.103903 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b9d76418-e121-42d0-aeaf-85912918cdab tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:02.104334 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b9d76418-e121-42d0-aeaf-85912918cdab tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:02.105010 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b9d76418-e121-42d0-aeaf-85912918cdab tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:02.105454 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b9d76418-e121-42d0-aeaf-85912918cdab tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:02.105871 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b9d76418-e121-42d0-aeaf-85912918cdab tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:02.236736 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-b9d76418-e121-42d0-aeaf-85912918cdab tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:02.244484 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-b9d76418-e121-42d0-aeaf-85912918cdab tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1735 microversion: 2.1 time: 0.151881 Aug 12 11:54:02.245033 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 300/605] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:02 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:54:03.265009 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-9964a2e2-6214-4ae5-aef9-2c5ac4a395b9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:03.265619 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-9964a2e2-6214-4ae5-aef9-2c5ac4a395b9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:03.272079 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9964a2e2-6214-4ae5-aef9-2c5ac4a395b9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:03.272558 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9964a2e2-6214-4ae5-aef9-2c5ac4a395b9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:03.272991 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9964a2e2-6214-4ae5-aef9-2c5ac4a395b9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:03.273680 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9964a2e2-6214-4ae5-aef9-2c5ac4a395b9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:03.274286 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9964a2e2-6214-4ae5-aef9-2c5ac4a395b9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:03.275066 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9964a2e2-6214-4ae5-aef9-2c5ac4a395b9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:03.408664 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-9964a2e2-6214-4ae5-aef9-2c5ac4a395b9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:03.416680 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-9964a2e2-6214-4ae5-aef9-2c5ac4a395b9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1735 microversion: 2.1 time: 0.155520 Aug 12 11:54:03.417238 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 306/606] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:03 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:03.874817 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-7f64d997-deaa-4c10-b79c-f03d24f9fe55 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:03.875359 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-7f64d997-deaa-4c10-b79c-f03d24f9fe55 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:03.881648 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7f64d997-deaa-4c10-b79c-f03d24f9fe55 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:03.882121 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7f64d997-deaa-4c10-b79c-f03d24f9fe55 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:03.882579 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7f64d997-deaa-4c10-b79c-f03d24f9fe55 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:03.883282 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7f64d997-deaa-4c10-b79c-f03d24f9fe55 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:03.883725 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7f64d997-deaa-4c10-b79c-f03d24f9fe55 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:03.884143 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7f64d997-deaa-4c10-b79c-f03d24f9fe55 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:03.914778 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-7f64d997-deaa-4c10-b79c-f03d24f9fe55 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531/os-volume_attachments/b4e9ec4e-6bab-488a-abb3-3355b773aceb" status: 200 len: 194 microversion: 2.20 time: 0.044037 Aug 12 11:54:03.915336 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 301/607] 10.222.0.42 () {60 vars in 1454 bytes} [Fri Aug 12 11:54:03 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531/os-volume_attachments/b4e9ec4e-6bab-488a-abb3-3355b773aceb => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 11:54:03.991925 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-7691b2da-04cf-4d91-8f91-1aa27df1a3e4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:03.992445 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-7691b2da-04cf-4d91-8f91-1aa27df1a3e4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:03.998511 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7691b2da-04cf-4d91-8f91-1aa27df1a3e4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:03.999018 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7691b2da-04cf-4d91-8f91-1aa27df1a3e4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:03.999445 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7691b2da-04cf-4d91-8f91-1aa27df1a3e4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:04.000122 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7691b2da-04cf-4d91-8f91-1aa27df1a3e4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:04.000569 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7691b2da-04cf-4d91-8f91-1aa27df1a3e4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:04.000985 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7691b2da-04cf-4d91-8f91-1aa27df1a3e4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:04.079780 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.objects.instance [None req-7691b2da-04cf-4d91-8f91-1aa27df1a3e4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lazy-loading 'services' on Instance uuid 712bb3a1-789a-442f-8d59-a635f0896531 {{(pid=132281) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:54:04.148569 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-7691b2da-04cf-4d91-8f91-1aa27df1a3e4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "DELETE /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531/os-volume_attachments/b4e9ec4e-6bab-488a-abb3-3355b773aceb" status: 202 len: 0 microversion: 2.20 time: 0.160359 Aug 12 11:54:04.149158 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 307/608] 10.222.0.42 () {60 vars in 1457 bytes} [Fri Aug 12 11:54:03 2022] DELETE /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531/os-volume_attachments/b4e9ec4e-6bab-488a-abb3-3355b773aceb => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 12 11:54:04.157409 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-08f0b95a-348b-48b1-86b3-713338f05a10 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:04.159660 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-08f0b95a-348b-48b1-86b3-713338f05a10 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:04.165489 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-08f0b95a-348b-48b1-86b3-713338f05a10 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:04.166017 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-08f0b95a-348b-48b1-86b3-713338f05a10 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:04.166497 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-08f0b95a-348b-48b1-86b3-713338f05a10 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:04.167209 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-08f0b95a-348b-48b1-86b3-713338f05a10 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:04.167680 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-08f0b95a-348b-48b1-86b3-713338f05a10 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:04.168115 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-08f0b95a-348b-48b1-86b3-713338f05a10 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:04.199065 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-08f0b95a-348b-48b1-86b3-713338f05a10 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045564 Aug 12 11:54:04.199615 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 302/609] 10.222.0.42 () {60 vars in 1343 bytes} [Fri Aug 12 11:54:04 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 11:54:04.441341 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-0acc7432-88f4-4bae-9727-61904400016a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:04.441944 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-0acc7432-88f4-4bae-9727-61904400016a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:04.447980 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0acc7432-88f4-4bae-9727-61904400016a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:04.448448 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0acc7432-88f4-4bae-9727-61904400016a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:04.448872 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0acc7432-88f4-4bae-9727-61904400016a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:04.449542 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0acc7432-88f4-4bae-9727-61904400016a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:04.450012 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0acc7432-88f4-4bae-9727-61904400016a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:04.450423 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0acc7432-88f4-4bae-9727-61904400016a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:04.467989 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:04.583783 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-0acc7432-88f4-4bae-9727-61904400016a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:04.591683 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-0acc7432-88f4-4bae-9727-61904400016a tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1735 microversion: 2.1 time: 0.155992 Aug 12 11:54:04.592243 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 308/610] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:04 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:05.212266 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-68ad5daf-5740-4f8c-b23c-7f92951b41e2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:05.214469 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-68ad5daf-5740-4f8c-b23c-7f92951b41e2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:05.221231 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-68ad5daf-5740-4f8c-b23c-7f92951b41e2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:05.221702 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-68ad5daf-5740-4f8c-b23c-7f92951b41e2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:05.222132 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-68ad5daf-5740-4f8c-b23c-7f92951b41e2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:05.222858 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-68ad5daf-5740-4f8c-b23c-7f92951b41e2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:05.223304 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-68ad5daf-5740-4f8c-b23c-7f92951b41e2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:05.223721 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-68ad5daf-5740-4f8c-b23c-7f92951b41e2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:05.252659 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-68ad5daf-5740-4f8c-b23c-7f92951b41e2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044370 Aug 12 11:54:05.253205 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 303/611] 10.222.0.42 () {60 vars in 1343 bytes} [Fri Aug 12 11:54:05 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 11:54:05.612081 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-f4237504-f8b8-44ad-879f-16f2fd42cf1e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:05.612788 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-f4237504-f8b8-44ad-879f-16f2fd42cf1e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:05.619462 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f4237504-f8b8-44ad-879f-16f2fd42cf1e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:05.619940 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f4237504-f8b8-44ad-879f-16f2fd42cf1e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:05.620370 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f4237504-f8b8-44ad-879f-16f2fd42cf1e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:05.621045 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f4237504-f8b8-44ad-879f-16f2fd42cf1e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:05.621489 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f4237504-f8b8-44ad-879f-16f2fd42cf1e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:05.621904 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f4237504-f8b8-44ad-879f-16f2fd42cf1e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:05.746200 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-f4237504-f8b8-44ad-879f-16f2fd42cf1e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:05.754573 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-f4237504-f8b8-44ad-879f-16f2fd42cf1e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1735 microversion: 2.1 time: 0.146332 Aug 12 11:54:05.755170 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 309/612] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:05 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:06.265566 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-0af16cb3-9d03-4470-b517-c8598dd57f90 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:06.267673 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-0af16cb3-9d03-4470-b517-c8598dd57f90 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:06.274065 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0af16cb3-9d03-4470-b517-c8598dd57f90 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:06.274546 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0af16cb3-9d03-4470-b517-c8598dd57f90 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:06.275016 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0af16cb3-9d03-4470-b517-c8598dd57f90 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:06.275701 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0af16cb3-9d03-4470-b517-c8598dd57f90 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:06.276151 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0af16cb3-9d03-4470-b517-c8598dd57f90 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:06.276571 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0af16cb3-9d03-4470-b517-c8598dd57f90 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:06.304182 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-0af16cb3-9d03-4470-b517-c8598dd57f90 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043222 Aug 12 11:54:06.304722 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 304/613] 10.222.0.42 () {60 vars in 1343 bytes} [Fri Aug 12 11:54:06 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:06.369835 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-8c5d79d3-b90f-46b1-93e2-02971b8a0c5d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:06.370332 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-8c5d79d3-b90f-46b1-93e2-02971b8a0c5d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:06.378429 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8c5d79d3-b90f-46b1-93e2-02971b8a0c5d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:06.378946 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8c5d79d3-b90f-46b1-93e2-02971b8a0c5d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:06.379381 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8c5d79d3-b90f-46b1-93e2-02971b8a0c5d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:06.380063 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8c5d79d3-b90f-46b1-93e2-02971b8a0c5d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:06.380514 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8c5d79d3-b90f-46b1-93e2-02971b8a0c5d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:06.380933 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8c5d79d3-b90f-46b1-93e2-02971b8a0c5d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:06.405084 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-8c5d79d3-b90f-46b1-93e2-02971b8a0c5d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Going to try to terminate instance {{(pid=132281) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 11:54:06.478215 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-8c5d79d3-b90f-46b1-93e2-02971b8a0c5d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "DELETE /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 204 len: 0 microversion: 2.20 time: 0.111910 Aug 12 11:54:06.479079 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 310/614] 10.222.0.42 () {60 vars in 1280 bytes} [Fri Aug 12 11:54:06 2022] DELETE /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 12 11:54:06.487418 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-aaa3aea0-abf7-48d5-a8b4-f78f15acc550 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:06.488022 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-aaa3aea0-abf7-48d5-a8b4-f78f15acc550 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:06.494114 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-aaa3aea0-abf7-48d5-a8b4-f78f15acc550 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:06.494584 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-aaa3aea0-abf7-48d5-a8b4-f78f15acc550 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:06.495051 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-aaa3aea0-abf7-48d5-a8b4-f78f15acc550 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:06.495728 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-aaa3aea0-abf7-48d5-a8b4-f78f15acc550 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:06.496172 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-aaa3aea0-abf7-48d5-a8b4-f78f15acc550 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:06.496592 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-aaa3aea0-abf7-48d5-a8b4-f78f15acc550 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:06.623485 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-aaa3aea0-abf7-48d5-a8b4-f78f15acc550 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:06.631296 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-aaa3aea0-abf7-48d5-a8b4-f78f15acc550 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:06.632824 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-aaa3aea0-abf7-48d5-a8b4-f78f15acc550 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:06.633975 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-aaa3aea0-abf7-48d5-a8b4-f78f15acc550 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1724 microversion: 2.20 time: 0.150429 Aug 12 11:54:06.634522 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 305/615] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:54:06 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:54:06.776859 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-69ebd836-84dc-4ec3-af07-6249223d64b3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:06.777574 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-69ebd836-84dc-4ec3-af07-6249223d64b3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:06.784447 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-69ebd836-84dc-4ec3-af07-6249223d64b3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:06.784913 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-69ebd836-84dc-4ec3-af07-6249223d64b3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:06.785337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-69ebd836-84dc-4ec3-af07-6249223d64b3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:06.786009 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-69ebd836-84dc-4ec3-af07-6249223d64b3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:06.786447 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-69ebd836-84dc-4ec3-af07-6249223d64b3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:06.786887 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-69ebd836-84dc-4ec3-af07-6249223d64b3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:06.917513 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-69ebd836-84dc-4ec3-af07-6249223d64b3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:06.925533 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-69ebd836-84dc-4ec3-af07-6249223d64b3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1735 microversion: 2.1 time: 0.152840 Aug 12 11:54:06.926095 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 311/616] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:06 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:07.656247 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-88abfce7-33f4-4fb4-96f7-8e25dc3699e1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:07.656874 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-88abfce7-33f4-4fb4-96f7-8e25dc3699e1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:07.663156 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-88abfce7-33f4-4fb4-96f7-8e25dc3699e1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:07.663629 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-88abfce7-33f4-4fb4-96f7-8e25dc3699e1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:07.664060 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-88abfce7-33f4-4fb4-96f7-8e25dc3699e1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:07.664732 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-88abfce7-33f4-4fb4-96f7-8e25dc3699e1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:07.665177 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-88abfce7-33f4-4fb4-96f7-8e25dc3699e1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:07.665600 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-88abfce7-33f4-4fb4-96f7-8e25dc3699e1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:07.791373 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-88abfce7-33f4-4fb4-96f7-8e25dc3699e1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:07.799727 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-88abfce7-33f4-4fb4-96f7-8e25dc3699e1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:07.801224 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-88abfce7-33f4-4fb4-96f7-8e25dc3699e1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:07.802376 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-88abfce7-33f4-4fb4-96f7-8e25dc3699e1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1724 microversion: 2.20 time: 0.150054 Aug 12 11:54:07.802971 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 306/617] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:54:07 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:54:07.947018 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e4eb90dc-fdbb-46d8-96eb-36a84019c30e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:07.947554 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-e4eb90dc-fdbb-46d8-96eb-36a84019c30e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:07.953905 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e4eb90dc-fdbb-46d8-96eb-36a84019c30e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:07.954376 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e4eb90dc-fdbb-46d8-96eb-36a84019c30e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:07.954833 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e4eb90dc-fdbb-46d8-96eb-36a84019c30e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:07.955511 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e4eb90dc-fdbb-46d8-96eb-36a84019c30e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:07.955954 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e4eb90dc-fdbb-46d8-96eb-36a84019c30e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:07.956368 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e4eb90dc-fdbb-46d8-96eb-36a84019c30e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:08.086182 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-e4eb90dc-fdbb-46d8-96eb-36a84019c30e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:08.094592 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-e4eb90dc-fdbb-46d8-96eb-36a84019c30e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1735 microversion: 2.1 time: 0.151569 Aug 12 11:54:08.095180 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 312/618] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:07 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:08.825249 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e7c58318-bb99-447e-a863-764d0a719cec tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:08.825857 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-e7c58318-bb99-447e-a863-764d0a719cec tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:08.832819 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e7c58318-bb99-447e-a863-764d0a719cec tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:08.833307 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e7c58318-bb99-447e-a863-764d0a719cec tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:08.833743 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e7c58318-bb99-447e-a863-764d0a719cec tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:08.834432 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e7c58318-bb99-447e-a863-764d0a719cec tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:08.834916 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e7c58318-bb99-447e-a863-764d0a719cec tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:08.835346 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e7c58318-bb99-447e-a863-764d0a719cec tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:09.116922 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-8fb23105-0bc2-46fe-9b8f-8cf12d3740c1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:09.117445 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-8fb23105-0bc2-46fe-9b8f-8cf12d3740c1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:09.123896 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8fb23105-0bc2-46fe-9b8f-8cf12d3740c1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:09.124379 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8fb23105-0bc2-46fe-9b8f-8cf12d3740c1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:09.124812 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8fb23105-0bc2-46fe-9b8f-8cf12d3740c1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:09.125502 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8fb23105-0bc2-46fe-9b8f-8cf12d3740c1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:09.125951 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8fb23105-0bc2-46fe-9b8f-8cf12d3740c1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:09.126370 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8fb23105-0bc2-46fe-9b8f-8cf12d3740c1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:09.397375 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e7c58318-bb99-447e-a863-764d0a719cec tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:09.400587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-8fb23105-0bc2-46fe-9b8f-8cf12d3740c1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:09.400892 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:09.406381 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e7c58318-bb99-447e-a863-764d0a719cec tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:09.407898 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e7c58318-bb99-447e-a863-764d0a719cec tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:09.409081 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e7c58318-bb99-447e-a863-764d0a719cec tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 200 len: 1724 microversion: 2.20 time: 0.587819 Aug 12 11:54:09.409481 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-8fb23105-0bc2-46fe-9b8f-8cf12d3740c1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1735 microversion: 2.1 time: 0.296430 Aug 12 11:54:09.410223 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 313/619] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:09 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1735 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:54:09.414104 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 307/620] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:54:08 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 1724 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:54:09.781024 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-8ed7af79-a2c0-4962-9657-2f73e5c50496 req-569ab2ac-41f9-411a-ab1a-9754a259953c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712bb3a1-789a-442f-8d59-a635f0896531", "name": "network-vif-deleted", "tag": "0a1aa4d3-f810-4d8a-b28b-30a0d82ce0c9"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:54:09.791532 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-8ed7af79-a2c0-4962-9657-2f73e5c50496 req-569ab2ac-41f9-411a-ab1a-9754a259953c service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:09.792014 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-8ed7af79-a2c0-4962-9657-2f73e5c50496 req-569ab2ac-41f9-411a-ab1a-9754a259953c service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:09.792443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-8ed7af79-a2c0-4962-9657-2f73e5c50496 req-569ab2ac-41f9-411a-ab1a-9754a259953c service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:09.804323 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-8ed7af79-a2c0-4962-9657-2f73e5c50496 req-569ab2ac-41f9-411a-ab1a-9754a259953c service nova] Creating event network-vif-deleted:0a1aa4d3-f810-4d8a-b28b-30a0d82ce0c9 for instance 712bb3a1-789a-442f-8d59-a635f0896531 on hv-cinder-85282 Aug 12 11:54:09.809415 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-8ed7af79-a2c0-4962-9657-2f73e5c50496 req-569ab2ac-41f9-411a-ab1a-9754a259953c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031711 Aug 12 11:54:09.810811 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 314/621] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:54:10.432547 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-8b542422-6c05-4533-a713-f1949a19e772 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:10.433553 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-8b542422-6c05-4533-a713-f1949a19e772 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:10.433688 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-a967f332-4525-42dc-b0d8-3fd5211947d4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:10.435462 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-a967f332-4525-42dc-b0d8-3fd5211947d4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:10.440800 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8b542422-6c05-4533-a713-f1949a19e772 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:10.441545 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8b542422-6c05-4533-a713-f1949a19e772 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:10.442223 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8b542422-6c05-4533-a713-f1949a19e772 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:10.443163 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8b542422-6c05-4533-a713-f1949a19e772 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:10.443806 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8b542422-6c05-4533-a713-f1949a19e772 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:10.444530 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8b542422-6c05-4533-a713-f1949a19e772 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:10.445443 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a967f332-4525-42dc-b0d8-3fd5211947d4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:10.446086 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a967f332-4525-42dc-b0d8-3fd5211947d4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:10.446905 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a967f332-4525-42dc-b0d8-3fd5211947d4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:10.449041 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a967f332-4525-42dc-b0d8-3fd5211947d4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:10.449518 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a967f332-4525-42dc-b0d8-3fd5211947d4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:10.449947 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a967f332-4525-42dc-b0d8-3fd5211947d4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:10.469087 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.wsgi [None req-a967f332-4525-42dc-b0d8-3fd5211947d4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] HTTP exception thrown: Instance 712bb3a1-789a-442f-8d59-a635f0896531 could not be found. Aug 12 11:54:10.471206 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-a967f332-4525-42dc-b0d8-3fd5211947d4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Request method failure captured: Aug 12 11:54:10.471206 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 HTTP/1.1 Aug 12 11:54:10.471206 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 11:54:10.471206 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 11:54:10.471206 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 11:54:10.471206 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 0 Aug 12 11:54:10.471206 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 11:54:10.471206 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 11:54:10.471206 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 11:54:10.471206 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 11:54:10.471206 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9j5d3bsL9h8VyUoZAxGHLHkHNUioAqmnqDFdF4BmFvpJij50HpEhqoeOfQLVTDBD7wrHpnf_hetPyZyJymqbBPyyArpCWmTwVEpc5CwTRxVHEvEkaTxVf2I6RLHSslWk7Dc-nTsZDSGsflAdDk_n8g5eDlIWmv4QDZNHAcZT3PqyNtI Aug 12 11:54:10.471206 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 11:54:10.471206 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 11:54:10.471206 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 11:54:10.471206 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 11:54:10.471206 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 11:54:10.471206 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 11:54:10.471206 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 11:54:10.471206 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: 34010de730e4448288baf7e944d52cf9 Aug 12 11:54:10.471206 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1240343559 Aug 12 11:54:10.471206 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 11:54:10.471206 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 11:54:10.472739 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_34010de730e4448288baf7e944d52cf9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/34010de730e4448288baf7e944d52cf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34010de730e4448288baf7e944d52cf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34010de730e4448288baf7e944d52cf9"}]}] Aug 12 11:54:10.472739 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1240343559 Aug 12 11:54:10.472739 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: 34010de730e4448288baf7e944d52cf9 Aug 12 11:54:10.472739 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1240343559 Aug 12 11:54:10.472739 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-AttachVolumeShelveTestJSON-1240343559-project Aug 12 11:54:10.472739 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 11:54:10.472739 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 11:54:10.472739 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: 7d02a90e6cb7428985fe399974b385b9 Aug 12 11:54:10.472739 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1240343559-project Aug 12 11:54:10.472739 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: > Aug 12 11:54:10.472739 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Instance 712bb3a1-789a-442f-8d59-a635f0896531 could not be found. Aug 12 11:54:10.472739 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'id': '712bb3a1-789a-442f-8d59-a635f0896531'} Aug 12 11:54:10.473516 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:54:10.473516 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:54:10.473516 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:54:10.473516 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:54:10.473516 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:54:10.473516 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:54:10.473516 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:54:10.473516 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:54:10.473516 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:54:10.473516 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:54:10.473516 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 712bb3a1-789a-442f-8d59-a635f0896531 could not be found. Aug 12 11:54:10.473516 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:54:10.473516 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:54:10.473516 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:54:10.473516 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:54:10.473516 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:54:10.473516 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:54:10.473516 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:54:10.473516 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:54:10.473516 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:54:10.474886 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:54:10.474886 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:54:10.474886 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:54:10.474886 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:54:10.474886 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:54:10.474886 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:54:10.474886 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:54:10.474886 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 712bb3a1-789a-442f-8d59-a635f0896531 could not be found. Aug 12 11:54:10.474886 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:54:10.474886 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:54:10.474886 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:54:10.474886 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:54:10.474886 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:54:10.474886 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:54:10.474886 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:54:10.474886 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:54:10.474886 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 712bb3a1-789a-442f-8d59-a635f0896531 could not be found. Aug 12 11:54:10.474886 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:54:10.476061 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-a967f332-4525-42dc-b0d8-3fd5211947d4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Returning 404 to user: Instance 712bb3a1-789a-442f-8d59-a635f0896531 could not be found. {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:54:10.476061 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-a967f332-4525-42dc-b0d8-3fd5211947d4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 404 len: 111 microversion: 2.20 time: 0.044471 Aug 12 11:54:10.476061 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 308/622] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:54:10 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 12 11:54:10.481063 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-89175c0b-03b9-4b1a-a0ff-14f3fb423165 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '.version_select at 0x7f3e583613a0>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:10.504023 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-89175c0b-03b9-4b1a-a0ff-14f3fb423165 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1165031880" status: 204 len: 0 microversion: 2.20 time: 0.026443 Aug 12 11:54:10.504972 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 309/623] 10.222.0.42 () {60 vars in 1262 bytes} [Fri Aug 12 11:54:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1165031880 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 12 11:54:10.606088 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-8b542422-6c05-4533-a713-f1949a19e772 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:10.622875 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-8b542422-6c05-4533-a713-f1949a19e772 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1735 microversion: 2.1 time: 0.194171 Aug 12 11:54:10.623539 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 315/624] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:10 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1735 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:11.196285 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-965fd851-6472-4f00-85d7-0afcfb9b4ef0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Action: 'create', calling method: .version_select at 0x7f3e5827b5e0>, body: {"keypair": {"name": "tempest-keypair-1110829837", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL58zaYFolWTdsTa6HV/VZADoa2X+Yk5SRocrtgaYECrJI/qnrR45WvV9zaMq+nVj5/OfH8oOPAvFm8+rULObkZQ883m3uYQX6L3KAk9EQVwKEIOwt63Yy45FIVx6dnvkw=="}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:54:11.212005 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-965fd851-6472-4f00-85d7-0afcfb9b4ef0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Getting quotas for project 34010de730e4448288baf7e944d52cf9. Resources: {'key_pairs'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:54:11.216037 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-965fd851-6472-4f00-85d7-0afcfb9b4ef0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Getting quotas for user 7d02a90e6cb7428985fe399974b385b9 and project 34010de730e4448288baf7e944d52cf9. Resources: {'key_pairs'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:54:11.244344 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-965fd851-6472-4f00-85d7-0afcfb9b4ef0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.051901 Aug 12 11:54:11.244958 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 310/625] 10.222.0.42 () {62 vars in 1200 bytes} [Fri Aug 12 11:54:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 12 11:54:11.644377 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-c9ec3062-3b83-43e1-b90e-753fcdf3c5b7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:11.645078 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-c9ec3062-3b83-43e1-b90e-753fcdf3c5b7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:11.650548 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:11.652612 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c9ec3062-3b83-43e1-b90e-753fcdf3c5b7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:11.653162 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c9ec3062-3b83-43e1-b90e-753fcdf3c5b7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:11.653658 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c9ec3062-3b83-43e1-b90e-753fcdf3c5b7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:11.654407 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c9ec3062-3b83-43e1-b90e-753fcdf3c5b7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:11.655488 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c9ec3062-3b83-43e1-b90e-753fcdf3c5b7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:11.655980 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c9ec3062-3b83-43e1-b90e-753fcdf3c5b7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:11.787760 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-c9ec3062-3b83-43e1-b90e-753fcdf3c5b7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:11.796252 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-c9ec3062-3b83-43e1-b90e-753fcdf3c5b7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1735 microversion: 2.1 time: 0.155841 Aug 12 11:54:11.796814 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 316/626] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:11 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:12.666027 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-f4076393-d289-4616-a0d7-de9e74496bf7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-927908048", "imageRef": "2887ca5b-6aa2-4cc4-a2be-9322a733fc6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f9c5784f-2937-48fa-ba25-08d09529e1bf"}], "security_groups": [{"name": "tempest-securitygroup--898983023"}], "key_name": "tempest-keypair-1110829837", "user_data": "}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:54:12.765733 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.network.neutron [None req-f4076393-d289-4616-a0d7-de9e74496bf7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] validate_networks() for [('f9c5784f-2937-48fa-ba25-08d09529e1bf', None, None, None, None, None)] {{(pid=132282) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 11:54:12.818114 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-dc1a746f-9f71-478a-83e5-3629af164ea3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:12.818750 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-dc1a746f-9f71-478a-83e5-3629af164ea3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:12.825048 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dc1a746f-9f71-478a-83e5-3629af164ea3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:12.825528 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dc1a746f-9f71-478a-83e5-3629af164ea3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:12.825959 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dc1a746f-9f71-478a-83e5-3629af164ea3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:12.826698 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dc1a746f-9f71-478a-83e5-3629af164ea3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:12.827121 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dc1a746f-9f71-478a-83e5-3629af164ea3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:12.827537 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dc1a746f-9f71-478a-83e5-3629af164ea3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:13.016803 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-dc1a746f-9f71-478a-83e5-3629af164ea3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:13.024757 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-dc1a746f-9f71-478a-83e5-3629af164ea3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1735 microversion: 2.1 time: 0.210445 Aug 12 11:54:13.025317 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 317/627] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:12 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:54:13.183847 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-f4076393-d289-4616-a0d7-de9e74496bf7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Flavor limits 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 11:54:13.184526 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-f4076393-d289-4616-a0d7-de9e74496bf7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Image limits 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 11:54:13.185000 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-f4076393-d289-4616-a0d7-de9e74496bf7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Flavor pref 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 11:54:13.185407 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-f4076393-d289-4616-a0d7-de9e74496bf7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Image pref 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 11:54:13.185817 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-f4076393-d289-4616-a0d7-de9e74496bf7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 11:54:13.195064 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f4076393-d289-4616-a0d7-de9e74496bf7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:13.195540 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f4076393-d289-4616-a0d7-de9e74496bf7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:13.195971 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f4076393-d289-4616-a0d7-de9e74496bf7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:13.196687 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f4076393-d289-4616-a0d7-de9e74496bf7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:13.197137 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f4076393-d289-4616-a0d7-de9e74496bf7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:13.197561 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f4076393-d289-4616-a0d7-de9e74496bf7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:13.213590 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-f4076393-d289-4616-a0d7-de9e74496bf7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Getting quotas for project 34010de730e4448288baf7e944d52cf9. Resources: {'instances', 'ram', 'cores'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:54:13.218045 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-f4076393-d289-4616-a0d7-de9e74496bf7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Getting quotas for user 7d02a90e6cb7428985fe399974b385b9 and project 34010de730e4448288baf7e944d52cf9. Resources: {'instances', 'ram', 'cores'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:54:13.229240 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-f4076393-d289-4616-a0d7-de9e74496bf7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Going to run 1 instances... {{(pid=132282) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 11:54:13.231491 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-f4076393-d289-4616-a0d7-de9e74496bf7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2887ca5b-6aa2-4cc4-a2be-9322a733fc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132282) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 11:54:13.276556 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-f4076393-d289-4616-a0d7-de9e74496bf7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.615374 Aug 12 11:54:13.277193 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 311/628] 10.222.0.42 () {62 vars in 1188 bytes} [Fri Aug 12 11:54:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 12 11:54:13.288678 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-95f44df8-f041-4cbc-9b2e-7e37ed2c1ad0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:13.289291 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-95f44df8-f041-4cbc-9b2e-7e37ed2c1ad0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:13.346339 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-95f44df8-f041-4cbc-9b2e-7e37ed2c1ad0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:13.353878 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-95f44df8-f041-4cbc-9b2e-7e37ed2c1ad0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:13.355569 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-95f44df8-f041-4cbc-9b2e-7e37ed2c1ad0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:13.356668 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-95f44df8-f041-4cbc-9b2e-7e37ed2c1ad0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1281 microversion: 2.20 time: 0.072062 Aug 12 11:54:13.357252 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 318/629] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:54:13 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:54:14.046189 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-4b6f2c4d-44a5-4677-938d-15c91576c477 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:14.046834 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-4b6f2c4d-44a5-4677-938d-15c91576c477 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:14.052809 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4b6f2c4d-44a5-4677-938d-15c91576c477 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:14.053289 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4b6f2c4d-44a5-4677-938d-15c91576c477 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:14.053724 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4b6f2c4d-44a5-4677-938d-15c91576c477 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:14.054404 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4b6f2c4d-44a5-4677-938d-15c91576c477 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:14.054971 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4b6f2c4d-44a5-4677-938d-15c91576c477 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:14.055394 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4b6f2c4d-44a5-4677-938d-15c91576c477 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:14.183008 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-4b6f2c4d-44a5-4677-938d-15c91576c477 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:14.191764 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-4b6f2c4d-44a5-4677-938d-15c91576c477 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1735 microversion: 2.1 time: 0.149939 Aug 12 11:54:14.192313 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 312/630] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:14 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:14.380806 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-b7e6fff8-8230-4546-bb4f-59905c37df71 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:14.381520 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-b7e6fff8-8230-4546-bb4f-59905c37df71 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:14.388022 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b7e6fff8-8230-4546-bb4f-59905c37df71 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:14.388450 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b7e6fff8-8230-4546-bb4f-59905c37df71 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:14.388883 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b7e6fff8-8230-4546-bb4f-59905c37df71 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:14.389572 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b7e6fff8-8230-4546-bb4f-59905c37df71 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:14.390026 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b7e6fff8-8230-4546-bb4f-59905c37df71 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:14.390449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b7e6fff8-8230-4546-bb4f-59905c37df71 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:14.452177 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-b7e6fff8-8230-4546-bb4f-59905c37df71 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:14.460031 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-b7e6fff8-8230-4546-bb4f-59905c37df71 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:14.461545 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-b7e6fff8-8230-4546-bb4f-59905c37df71 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:14.462664 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-b7e6fff8-8230-4546-bb4f-59905c37df71 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1285 microversion: 2.20 time: 0.085914 Aug 12 11:54:14.463223 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 319/631] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:54:14 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:54:15.213406 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-4e8d1087-1d0e-4405-8bbc-823dc5d5e3a7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:15.214010 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-4e8d1087-1d0e-4405-8bbc-823dc5d5e3a7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:15.220917 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4e8d1087-1d0e-4405-8bbc-823dc5d5e3a7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:15.221394 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4e8d1087-1d0e-4405-8bbc-823dc5d5e3a7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:15.221829 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4e8d1087-1d0e-4405-8bbc-823dc5d5e3a7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:15.222512 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4e8d1087-1d0e-4405-8bbc-823dc5d5e3a7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:15.222983 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4e8d1087-1d0e-4405-8bbc-823dc5d5e3a7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:15.223401 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4e8d1087-1d0e-4405-8bbc-823dc5d5e3a7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:15.348781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-4e8d1087-1d0e-4405-8bbc-823dc5d5e3a7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:15.356584 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-4e8d1087-1d0e-4405-8bbc-823dc5d5e3a7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1735 microversion: 2.1 time: 0.147150 Aug 12 11:54:15.357134 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 313/632] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:15 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:15.484060 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-1e17939e-a3d5-4b73-bcbf-a01cb602d44d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:15.484595 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-1e17939e-a3d5-4b73-bcbf-a01cb602d44d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:15.490967 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1e17939e-a3d5-4b73-bcbf-a01cb602d44d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:15.491443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1e17939e-a3d5-4b73-bcbf-a01cb602d44d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:15.491876 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1e17939e-a3d5-4b73-bcbf-a01cb602d44d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:15.492554 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1e17939e-a3d5-4b73-bcbf-a01cb602d44d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:15.493002 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1e17939e-a3d5-4b73-bcbf-a01cb602d44d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:15.493418 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1e17939e-a3d5-4b73-bcbf-a01cb602d44d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:15.552611 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-1e17939e-a3d5-4b73-bcbf-a01cb602d44d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:15.560528 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-1e17939e-a3d5-4b73-bcbf-a01cb602d44d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:15.562523 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-1e17939e-a3d5-4b73-bcbf-a01cb602d44d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:15.563627 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-1e17939e-a3d5-4b73-bcbf-a01cb602d44d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1333 microversion: 2.20 time: 0.083503 Aug 12 11:54:15.564177 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 320/633] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:54:15 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1333 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:54:16.377776 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-dfefec4c-162e-493d-9235-4ac40c8db368 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:16.378410 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-dfefec4c-162e-493d-9235-4ac40c8db368 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:16.384683 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-dfefec4c-162e-493d-9235-4ac40c8db368 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:16.385160 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-dfefec4c-162e-493d-9235-4ac40c8db368 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:16.385594 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-dfefec4c-162e-493d-9235-4ac40c8db368 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:16.386271 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-dfefec4c-162e-493d-9235-4ac40c8db368 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:16.386741 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-dfefec4c-162e-493d-9235-4ac40c8db368 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:16.387162 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-dfefec4c-162e-493d-9235-4ac40c8db368 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:16.515585 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-dfefec4c-162e-493d-9235-4ac40c8db368 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:16.523617 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-dfefec4c-162e-493d-9235-4ac40c8db368 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1735 microversion: 2.1 time: 0.149600 Aug 12 11:54:16.524169 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 314/634] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:16 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:16.586228 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-9e0e7117-7e55-477b-89e6-d2dae6ccd47f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:16.586865 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-9e0e7117-7e55-477b-89e6-d2dae6ccd47f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:16.593995 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9e0e7117-7e55-477b-89e6-d2dae6ccd47f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:16.594479 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9e0e7117-7e55-477b-89e6-d2dae6ccd47f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:16.594938 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9e0e7117-7e55-477b-89e6-d2dae6ccd47f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:16.595683 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9e0e7117-7e55-477b-89e6-d2dae6ccd47f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:16.596074 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9e0e7117-7e55-477b-89e6-d2dae6ccd47f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:16.596510 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9e0e7117-7e55-477b-89e6-d2dae6ccd47f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:16.663321 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-9e0e7117-7e55-477b-89e6-d2dae6ccd47f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:16.671202 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-9e0e7117-7e55-477b-89e6-d2dae6ccd47f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:16.672687 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-9e0e7117-7e55-477b-89e6-d2dae6ccd47f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:16.673753 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-9e0e7117-7e55-477b-89e6-d2dae6ccd47f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1339 microversion: 2.20 time: 0.091390 Aug 12 11:54:16.674305 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 321/635] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:54:16 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1339 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:54:17.545550 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-c100575f-557a-40cd-8b09-fe5b9487ecce tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:17.546063 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-c100575f-557a-40cd-8b09-fe5b9487ecce tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:17.552306 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c100575f-557a-40cd-8b09-fe5b9487ecce tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:17.552789 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c100575f-557a-40cd-8b09-fe5b9487ecce tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:17.553220 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c100575f-557a-40cd-8b09-fe5b9487ecce tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:17.553904 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c100575f-557a-40cd-8b09-fe5b9487ecce tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:17.554356 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c100575f-557a-40cd-8b09-fe5b9487ecce tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:17.554820 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c100575f-557a-40cd-8b09-fe5b9487ecce tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:17.696300 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-15b36f53-6da4-45d3-b976-a9df80f6cea4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:17.696976 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-15b36f53-6da4-45d3-b976-a9df80f6cea4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:17.704032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-15b36f53-6da4-45d3-b976-a9df80f6cea4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:17.704578 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-15b36f53-6da4-45d3-b976-a9df80f6cea4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:17.705091 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-15b36f53-6da4-45d3-b976-a9df80f6cea4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:17.705777 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-15b36f53-6da4-45d3-b976-a9df80f6cea4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:17.706243 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-15b36f53-6da4-45d3-b976-a9df80f6cea4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:17.706782 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-15b36f53-6da4-45d3-b976-a9df80f6cea4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:17.741884 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-c100575f-557a-40cd-8b09-fe5b9487ecce tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:17.750275 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-c100575f-557a-40cd-8b09-fe5b9487ecce tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1715 microversion: 2.1 time: 0.208672 Aug 12 11:54:17.750864 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 315/636] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:17 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1715 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:17.816963 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-0d4d5793-6b4e-4c74-9e42-8c024612479b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:17.817462 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-0d4d5793-6b4e-4c74-9e42-8c024612479b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:17.823932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0d4d5793-6b4e-4c74-9e42-8c024612479b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:17.824419 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0d4d5793-6b4e-4c74-9e42-8c024612479b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:17.824853 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0d4d5793-6b4e-4c74-9e42-8c024612479b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:17.825870 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0d4d5793-6b4e-4c74-9e42-8c024612479b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:17.826985 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0d4d5793-6b4e-4c74-9e42-8c024612479b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:17.827423 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0d4d5793-6b4e-4c74-9e42-8c024612479b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:17.938664 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-15b36f53-6da4-45d3-b976-a9df80f6cea4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:17.947866 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-15b36f53-6da4-45d3-b976-a9df80f6cea4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:17.949801 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-15b36f53-6da4-45d3-b976-a9df80f6cea4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:17.951843 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-15b36f53-6da4-45d3-b976-a9df80f6cea4 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1406 microversion: 2.20 time: 0.258996 Aug 12 11:54:17.952750 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 322/637] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:54:17 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1406 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:54:17.962481 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.wsgi [None req-0d4d5793-6b4e-4c74-9e42-8c024612479b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] HTTP exception thrown: Cannot 'detach_volume' instance 7545dc36-2c18-434c-94e4-771977a58319 while it is in vm_state rescued Aug 12 11:54:17.964253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-0d4d5793-6b4e-4c74-9e42-8c024612479b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Request method failure captured: Aug 12 11:54:17.964253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: DELETE /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319/os-volume_attachments/fde48ed1-a110-4ae9-a30b-fc5f73625c30 HTTP/1.1 Aug 12 11:54:17.964253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 11:54:17.964253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 11:54:17.964253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 11:54:17.964253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 0 Aug 12 11:54:17.964253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 11:54:17.964253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 11:54:17.964253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 11:54:17.964253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 11:54:17.964253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9j5mt6PNioe5iUGgp3CAkbSyYo_AhdYrVYhlzDi6Qs9O2Aks8er4C3JcoLHmjMk4ocUEKhdotNj2qgtAdK9WiQzA1AjEiu4Ps5qMdbbFZI3icMtnprp3XMTKgh0QwzwvvdyNK5uaTpRPPinF6P3wPdnin1wNbpohTf1mbuSCDgZlVZU Aug 12 11:54:17.964253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 11:54:17.964253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 11:54:17.964253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 11:54:17.964253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 11:54:17.964253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 11:54:17.964253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 11:54:17.964253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: a7e2fce9e9db463aa70188453f20d110 Aug 12 11:54:17.964253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-758473035 Aug 12 11:54:17.964253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 11:54:17.964253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 11:54:17.965852 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a7e2fce9e9db463aa70188453f20d110", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a7e2fce9e9db463aa70188453f20d110"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7e2fce9e9db463aa70188453f20d110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7e2fce9e9db463aa70188453f20d110"}]}] Aug 12 11:54:17.965852 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-ServerRescueNegativeTestJSON-758473035 Aug 12 11:54:17.965852 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: a7e2fce9e9db463aa70188453f20d110 Aug 12 11:54:17.965852 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-758473035 Aug 12 11:54:17.965852 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-ServerRescueNegativeTestJSON-758473035-project Aug 12 11:54:17.965852 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 11:54:17.965852 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 11:54:17.965852 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: 64ec7445644e478ca961be80f84f9863 Aug 12 11:54:17.965852 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-ServerRescueNegativeTestJSON-758473035-project Aug 12 11:54:17.965852 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: > Aug 12 11:54:17.965852 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Cannot 'detach_volume' instance 7545dc36-2c18-434c-94e4-771977a58319 while it is in vm_state rescued Aug 12 11:54:17.966685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'server_id': '7545dc36-2c18-434c-94e4-771977a58319', 'id': 'fde48ed1-a110-4ae9-a30b-fc5f73625c30'} Aug 12 11:54:17.966685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:54:17.966685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:54:17.966685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 12 11:54:17.966685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 12 11:54:17.966685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 12 11:54:17.966685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 12 11:54:17.966685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 12 11:54:17.966685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 12 11:54:17.966685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7545dc36-2c18-434c-94e4-771977a58319 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 12 11:54:17.966685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:54:17.966685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:54:17.966685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:54:17.966685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:54:17.966685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:54:17.966685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:54:17.966685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:54:17.966685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:54:17.966685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:54:17.966685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:54:17.968679 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 12 11:54:17.968679 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 12 11:54:17.968679 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 12 11:54:17.968679 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 12 11:54:17.968679 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7545dc36-2c18-434c-94e4-771977a58319 while it is in vm_state rescued Aug 12 11:54:17.968679 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:54:17.968679 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:54:17.968679 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:54:17.968679 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:54:17.968679 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:54:17.968679 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:54:17.968679 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:54:17.968679 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:54:17.968679 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7545dc36-2c18-434c-94e4-771977a58319 while it is in vm_state rescued Aug 12 11:54:17.968679 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:54:17.968679 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-0d4d5793-6b4e-4c74-9e42-8c024612479b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Returning 409 to user: Cannot 'detach_volume' instance 7545dc36-2c18-434c-94e4-771977a58319 while it is in vm_state rescued {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:54:17.969868 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-0d4d5793-6b4e-4c74-9e42-8c024612479b tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319/os-volume_attachments/fde48ed1-a110-4ae9-a30b-fc5f73625c30" status: 409 len: 152 microversion: 2.1 time: 0.155336 Aug 12 11:54:17.969868 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 316/638] 10.222.0.42 () {58 vars in 1416 bytes} [Fri Aug 12 11:54:17 2022] DELETE /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319/os-volume_attachments/fde48ed1-a110-4ae9-a30b-fc5f73625c30 => generated 152 bytes in 157 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 12 11:54:17.977070 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-6a7ed5c5-4aaa-4606-95a5-803901a37db3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:54:17.977594 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-6a7ed5c5-4aaa-4606-95a5-803901a37db3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:17.983591 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6a7ed5c5-4aaa-4606-95a5-803901a37db3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:17.984071 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6a7ed5c5-4aaa-4606-95a5-803901a37db3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:17.984501 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6a7ed5c5-4aaa-4606-95a5-803901a37db3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:17.985216 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6a7ed5c5-4aaa-4606-95a5-803901a37db3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:17.985666 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6a7ed5c5-4aaa-4606-95a5-803901a37db3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:17.986082 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6a7ed5c5-4aaa-4606-95a5-803901a37db3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:18.056460 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-64cbc4a1-dc1c-4667-b02c-ae42062518d8 req-60159602-4706-40a1-90ed-f5d7db36f757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "766f6d20-8985-4a72-b2d7-4062c001c834", "tag": "9f04531c-9036-4a8c-96e9-678608518051"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:54:18.061969 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-6a7ed5c5-4aaa-4606-95a5-803901a37db3 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "POST /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319/action" status: 202 len: 0 microversion: 2.1 time: 0.088636 Aug 12 11:54:18.063071 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 323/639] 10.222.0.42 () {60 vars in 1278 bytes} [Fri Aug 12 11:54:17 2022] POST /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:54:18.073747 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-85578b07-8cc4-4929-8d85-0081f4a98cd0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:18.074839 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-85578b07-8cc4-4929-8d85-0081f4a98cd0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:18.075063 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-64cbc4a1-dc1c-4667-b02c-ae42062518d8 req-60159602-4706-40a1-90ed-f5d7db36f757 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:18.076891 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-64cbc4a1-dc1c-4667-b02c-ae42062518d8 req-60159602-4706-40a1-90ed-f5d7db36f757 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:18.076891 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-64cbc4a1-dc1c-4667-b02c-ae42062518d8 req-60159602-4706-40a1-90ed-f5d7db36f757 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:18.084412 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-85578b07-8cc4-4929-8d85-0081f4a98cd0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:18.084984 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-85578b07-8cc4-4929-8d85-0081f4a98cd0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:18.085540 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-85578b07-8cc4-4929-8d85-0081f4a98cd0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:18.086235 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-85578b07-8cc4-4929-8d85-0081f4a98cd0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:18.087434 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-85578b07-8cc4-4929-8d85-0081f4a98cd0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:18.088572 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-85578b07-8cc4-4929-8d85-0081f4a98cd0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:18.090462 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-64cbc4a1-dc1c-4667-b02c-ae42062518d8 req-60159602-4706-40a1-90ed-f5d7db36f757 service nova] Creating event network-changed:9f04531c-9036-4a8c-96e9-678608518051 for instance 766f6d20-8985-4a72-b2d7-4062c001c834 on hv-cinder-85282 Aug 12 11:54:18.094953 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:18.104516 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-64cbc4a1-dc1c-4667-b02c-ae42062518d8 req-60159602-4706-40a1-90ed-f5d7db36f757 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059454 Aug 12 11:54:18.105053 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 317/640] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:54:18.288923 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-85578b07-8cc4-4929-8d85-0081f4a98cd0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:18.296867 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-85578b07-8cc4-4929-8d85-0081f4a98cd0 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1723 microversion: 2.1 time: 0.229336 Aug 12 11:54:18.297502 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 324/641] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:18 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:54:18.974304 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-c2cf1326-f4d4-471d-a327-5bf4f07f4586 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:18.975001 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-c2cf1326-f4d4-471d-a327-5bf4f07f4586 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:18.981016 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c2cf1326-f4d4-471d-a327-5bf4f07f4586 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:18.981493 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c2cf1326-f4d4-471d-a327-5bf4f07f4586 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:18.981922 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c2cf1326-f4d4-471d-a327-5bf4f07f4586 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:18.983118 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c2cf1326-f4d4-471d-a327-5bf4f07f4586 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:18.983567 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c2cf1326-f4d4-471d-a327-5bf4f07f4586 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:18.983985 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c2cf1326-f4d4-471d-a327-5bf4f07f4586 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:19.126109 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-c2cf1326-f4d4-471d-a327-5bf4f07f4586 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:19.133844 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-c2cf1326-f4d4-471d-a327-5bf4f07f4586 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:19.135362 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-c2cf1326-f4d4-471d-a327-5bf4f07f4586 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:19.136454 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-c2cf1326-f4d4-471d-a327-5bf4f07f4586 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1406 microversion: 2.20 time: 0.166841 Aug 12 11:54:19.136999 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 318/642] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:54:18 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:54:19.317944 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-7471ebb9-3b4d-4a75-9e81-cf452bf4e705 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:19.318542 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-7471ebb9-3b4d-4a75-9e81-cf452bf4e705 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:19.325057 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7471ebb9-3b4d-4a75-9e81-cf452bf4e705 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:19.325473 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7471ebb9-3b4d-4a75-9e81-cf452bf4e705 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:19.325896 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7471ebb9-3b4d-4a75-9e81-cf452bf4e705 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:19.326647 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7471ebb9-3b4d-4a75-9e81-cf452bf4e705 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:19.327097 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7471ebb9-3b4d-4a75-9e81-cf452bf4e705 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:19.327511 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7471ebb9-3b4d-4a75-9e81-cf452bf4e705 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:19.462881 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-7471ebb9-3b4d-4a75-9e81-cf452bf4e705 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:19.471539 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-7471ebb9-3b4d-4a75-9e81-cf452bf4e705 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1723 microversion: 2.1 time: 0.157391 Aug 12 11:54:19.472102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 325/643] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:19 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:20.158162 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-87778420-a4b1-4eec-a8ce-fdc66a7f12eb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:20.159478 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-87778420-a4b1-4eec-a8ce-fdc66a7f12eb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:20.166873 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-87778420-a4b1-4eec-a8ce-fdc66a7f12eb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:20.167491 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-87778420-a4b1-4eec-a8ce-fdc66a7f12eb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:20.167927 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-87778420-a4b1-4eec-a8ce-fdc66a7f12eb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:20.168626 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-87778420-a4b1-4eec-a8ce-fdc66a7f12eb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:20.169079 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-87778420-a4b1-4eec-a8ce-fdc66a7f12eb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:20.169582 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-87778420-a4b1-4eec-a8ce-fdc66a7f12eb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:20.492802 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-bfd1a7a9-a028-4a85-af0d-8ef1a4d12c72 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:20.493410 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-bfd1a7a9-a028-4a85-af0d-8ef1a4d12c72 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:20.500220 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bfd1a7a9-a028-4a85-af0d-8ef1a4d12c72 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:20.500691 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bfd1a7a9-a028-4a85-af0d-8ef1a4d12c72 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:20.501116 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bfd1a7a9-a028-4a85-af0d-8ef1a4d12c72 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:20.502001 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bfd1a7a9-a028-4a85-af0d-8ef1a4d12c72 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:20.502745 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bfd1a7a9-a028-4a85-af0d-8ef1a4d12c72 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:20.503213 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bfd1a7a9-a028-4a85-af0d-8ef1a4d12c72 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:20.539700 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-87778420-a4b1-4eec-a8ce-fdc66a7f12eb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:20.547811 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-87778420-a4b1-4eec-a8ce-fdc66a7f12eb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:20.549341 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-87778420-a4b1-4eec-a8ce-fdc66a7f12eb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:20.550442 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-87778420-a4b1-4eec-a8ce-fdc66a7f12eb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1406 microversion: 2.20 time: 0.396774 Aug 12 11:54:20.551027 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 319/644] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:54:20 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1406 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:54:20.636634 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-bfd1a7a9-a028-4a85-af0d-8ef1a4d12c72 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:20.645212 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-bfd1a7a9-a028-4a85-af0d-8ef1a4d12c72 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1723 microversion: 2.1 time: 0.156337 Aug 12 11:54:20.645778 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 326/645] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:20 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:54:20.741151 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-c67ac651-934f-4779-b3e7-33b7ccb43a4d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:20.743337 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-c67ac651-934f-4779-b3e7-33b7ccb43a4d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:20.749259 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c67ac651-934f-4779-b3e7-33b7ccb43a4d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:20.749734 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c67ac651-934f-4779-b3e7-33b7ccb43a4d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:20.750168 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c67ac651-934f-4779-b3e7-33b7ccb43a4d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:20.750877 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c67ac651-934f-4779-b3e7-33b7ccb43a4d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:20.751331 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c67ac651-934f-4779-b3e7-33b7ccb43a4d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:20.751753 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c67ac651-934f-4779-b3e7-33b7ccb43a4d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:20.778946 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-c67ac651-934f-4779-b3e7-33b7ccb43a4d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041646 Aug 12 11:54:20.779986 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 320/646] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Aug 12 11:54:20 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 11:54:20.839562 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-97a0b0d6-67f9-4a04-bcd4-788530f90874 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:20.840059 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-97a0b0d6-67f9-4a04-bcd4-788530f90874 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:20.846654 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-97a0b0d6-67f9-4a04-bcd4-788530f90874 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:20.847139 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-97a0b0d6-67f9-4a04-bcd4-788530f90874 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:20.847562 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-97a0b0d6-67f9-4a04-bcd4-788530f90874 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:20.848269 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-97a0b0d6-67f9-4a04-bcd4-788530f90874 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:20.848713 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-97a0b0d6-67f9-4a04-bcd4-788530f90874 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:20.849160 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-97a0b0d6-67f9-4a04-bcd4-788530f90874 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:20.873686 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-97a0b0d6-67f9-4a04-bcd4-788530f90874 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Going to try to terminate instance {{(pid=132281) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 11:54:20.949277 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-97a0b0d6-67f9-4a04-bcd4-788530f90874 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 204 len: 0 microversion: 2.1 time: 0.113286 Aug 12 11:54:20.949863 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 327/647] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Aug 12 11:54:20 2022] DELETE /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 11:54:20.958727 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-5c135c64-852c-4f16-80f0-75be3e7b0faf tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:20.959844 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-5c135c64-852c-4f16-80f0-75be3e7b0faf tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:20.965942 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5c135c64-852c-4f16-80f0-75be3e7b0faf tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:20.966426 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5c135c64-852c-4f16-80f0-75be3e7b0faf tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:20.967572 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5c135c64-852c-4f16-80f0-75be3e7b0faf tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:20.968268 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5c135c64-852c-4f16-80f0-75be3e7b0faf tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:20.968728 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5c135c64-852c-4f16-80f0-75be3e7b0faf tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:20.969153 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5c135c64-852c-4f16-80f0-75be3e7b0faf tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:21.094825 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-5c135c64-852c-4f16-80f0-75be3e7b0faf tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:21.102250 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-5c135c64-852c-4f16-80f0-75be3e7b0faf tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1675 microversion: 2.1 time: 0.147521 Aug 12 11:54:21.102833 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 321/648] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:20 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:21.574464 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-3a7ce961-7360-4d61-a210-72502d978671 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:21.575202 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-3a7ce961-7360-4d61-a210-72502d978671 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:21.582193 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3a7ce961-7360-4d61-a210-72502d978671 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:21.582709 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3a7ce961-7360-4d61-a210-72502d978671 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:21.583144 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3a7ce961-7360-4d61-a210-72502d978671 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:21.583825 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3a7ce961-7360-4d61-a210-72502d978671 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:21.584273 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3a7ce961-7360-4d61-a210-72502d978671 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:21.584690 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3a7ce961-7360-4d61-a210-72502d978671 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:21.668697 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-727d56cc-f008-4d19-866b-abc3f4981532 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:21.669304 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-727d56cc-f008-4d19-866b-abc3f4981532 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:21.678293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-727d56cc-f008-4d19-866b-abc3f4981532 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:21.678810 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-727d56cc-f008-4d19-866b-abc3f4981532 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:21.679243 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-727d56cc-f008-4d19-866b-abc3f4981532 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:21.679933 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-727d56cc-f008-4d19-866b-abc3f4981532 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:21.680380 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-727d56cc-f008-4d19-866b-abc3f4981532 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:21.680802 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-727d56cc-f008-4d19-866b-abc3f4981532 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:21.717779 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-3a7ce961-7360-4d61-a210-72502d978671 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:21.726074 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-3a7ce961-7360-4d61-a210-72502d978671 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:21.727605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-3a7ce961-7360-4d61-a210-72502d978671 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:21.728711 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-3a7ce961-7360-4d61-a210-72502d978671 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1406 microversion: 2.20 time: 0.158580 Aug 12 11:54:21.738987 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 328/649] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:54:21 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:54:21.863996 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-727d56cc-f008-4d19-866b-abc3f4981532 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:21.871898 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-727d56cc-f008-4d19-866b-abc3f4981532 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1723 microversion: 2.1 time: 0.206983 Aug 12 11:54:21.872457 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 322/650] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:21 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:22.123463 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-9eb16889-6f6a-4423-a81e-5bfb3eb1e22b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:22.124083 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-9eb16889-6f6a-4423-a81e-5bfb3eb1e22b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:22.130364 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9eb16889-6f6a-4423-a81e-5bfb3eb1e22b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:22.130914 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9eb16889-6f6a-4423-a81e-5bfb3eb1e22b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:22.131320 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9eb16889-6f6a-4423-a81e-5bfb3eb1e22b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:22.132067 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9eb16889-6f6a-4423-a81e-5bfb3eb1e22b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:22.132514 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9eb16889-6f6a-4423-a81e-5bfb3eb1e22b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:22.132959 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9eb16889-6f6a-4423-a81e-5bfb3eb1e22b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:22.265551 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-9eb16889-6f6a-4423-a81e-5bfb3eb1e22b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:22.273223 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-9eb16889-6f6a-4423-a81e-5bfb3eb1e22b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1675 microversion: 2.1 time: 0.154097 Aug 12 11:54:22.273889 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 329/651] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:22 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:22.752245 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-3c280d0e-1884-43d9-9eb9-6317cfc82ddb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:22.752874 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-3c280d0e-1884-43d9-9eb9-6317cfc82ddb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:22.755271 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:22.760605 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3c280d0e-1884-43d9-9eb9-6317cfc82ddb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:22.761085 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3c280d0e-1884-43d9-9eb9-6317cfc82ddb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:22.761526 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3c280d0e-1884-43d9-9eb9-6317cfc82ddb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:22.762215 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3c280d0e-1884-43d9-9eb9-6317cfc82ddb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:22.762692 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3c280d0e-1884-43d9-9eb9-6317cfc82ddb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:22.763123 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3c280d0e-1884-43d9-9eb9-6317cfc82ddb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:22.893645 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-3c280d0e-1884-43d9-9eb9-6317cfc82ddb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:22.894170 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e52bb20f-21c9-4845-9b57-0378a4de51d4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:22.895263 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-e52bb20f-21c9-4845-9b57-0378a4de51d4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:22.901504 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e52bb20f-21c9-4845-9b57-0378a4de51d4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:22.901991 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e52bb20f-21c9-4845-9b57-0378a4de51d4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:22.902100 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-3c280d0e-1884-43d9-9eb9-6317cfc82ddb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:22.902429 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e52bb20f-21c9-4845-9b57-0378a4de51d4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:22.903156 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e52bb20f-21c9-4845-9b57-0378a4de51d4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:22.903609 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-3c280d0e-1884-43d9-9eb9-6317cfc82ddb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:22.903715 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e52bb20f-21c9-4845-9b57-0378a4de51d4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:22.904050 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e52bb20f-21c9-4845-9b57-0378a4de51d4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:22.904752 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-3c280d0e-1884-43d9-9eb9-6317cfc82ddb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1406 microversion: 2.20 time: 0.156926 Aug 12 11:54:22.905293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 323/652] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:54:22 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:54:23.032873 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-e52bb20f-21c9-4845-9b57-0378a4de51d4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:23.040626 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-e52bb20f-21c9-4845-9b57-0378a4de51d4 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1723 microversion: 2.1 time: 0.150524 Aug 12 11:54:23.041191 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 330/653] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:22 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:54:23.294748 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-6b29ffb3-3222-4ab1-a441-819e628d6201 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:23.295870 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-6b29ffb3-3222-4ab1-a441-819e628d6201 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:23.297683 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=2 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:23.298323 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=10 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:23.303981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6b29ffb3-3222-4ab1-a441-819e628d6201 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:23.304456 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6b29ffb3-3222-4ab1-a441-819e628d6201 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:23.304889 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6b29ffb3-3222-4ab1-a441-819e628d6201 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:23.305567 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6b29ffb3-3222-4ab1-a441-819e628d6201 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:23.306014 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6b29ffb3-3222-4ab1-a441-819e628d6201 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:23.306431 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6b29ffb3-3222-4ab1-a441-819e628d6201 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:23.433530 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-6b29ffb3-3222-4ab1-a441-819e628d6201 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:23.441765 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-6b29ffb3-3222-4ab1-a441-819e628d6201 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1675 microversion: 2.1 time: 0.150867 Aug 12 11:54:23.442321 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 324/654] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:23 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:23.927027 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-fd7e12b5-abb7-4ecc-b13f-d2343f20c3ae tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:23.928128 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-fd7e12b5-abb7-4ecc-b13f-d2343f20c3ae tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:23.930328 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell0:SELECT=2 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:23.937458 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fd7e12b5-abb7-4ecc-b13f-d2343f20c3ae tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:23.938083 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fd7e12b5-abb7-4ecc-b13f-d2343f20c3ae tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:23.938655 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fd7e12b5-abb7-4ecc-b13f-d2343f20c3ae tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:23.939351 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fd7e12b5-abb7-4ecc-b13f-d2343f20c3ae tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:23.939803 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fd7e12b5-abb7-4ecc-b13f-d2343f20c3ae tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:23.940221 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fd7e12b5-abb7-4ecc-b13f-d2343f20c3ae tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:24.067347 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-1b608556-23e0-451b-9ca3-e27a4685d402 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:24.068068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-1b608556-23e0-451b-9ca3-e27a4685d402 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:24.074592 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1b608556-23e0-451b-9ca3-e27a4685d402 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:24.075184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1b608556-23e0-451b-9ca3-e27a4685d402 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:24.075756 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1b608556-23e0-451b-9ca3-e27a4685d402 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:24.077055 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1b608556-23e0-451b-9ca3-e27a4685d402 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:24.077595 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1b608556-23e0-451b-9ca3-e27a4685d402 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:24.078090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1b608556-23e0-451b-9ca3-e27a4685d402 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:24.111712 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-fd7e12b5-abb7-4ecc-b13f-d2343f20c3ae tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:24.119747 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-fd7e12b5-abb7-4ecc-b13f-d2343f20c3ae tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:24.121224 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-fd7e12b5-abb7-4ecc-b13f-d2343f20c3ae tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:24.122323 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-fd7e12b5-abb7-4ecc-b13f-d2343f20c3ae tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1406 microversion: 2.20 time: 0.199236 Aug 12 11:54:24.123157 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 331/655] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:54:23 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:54:24.213798 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-1b608556-23e0-451b-9ca3-e27a4685d402 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:24.221799 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-1b608556-23e0-451b-9ca3-e27a4685d402 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1729 microversion: 2.1 time: 0.158345 Aug 12 11:54:24.222367 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 325/656] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:24 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:54:24.242765 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-75a1c492-a618-437b-9bc7-b91707366711 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:24.243252 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-75a1c492-a618-437b-9bc7-b91707366711 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:24.249519 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-75a1c492-a618-437b-9bc7-b91707366711 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:24.249993 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-75a1c492-a618-437b-9bc7-b91707366711 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:24.250424 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-75a1c492-a618-437b-9bc7-b91707366711 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:24.251129 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-75a1c492-a618-437b-9bc7-b91707366711 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:24.251578 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-75a1c492-a618-437b-9bc7-b91707366711 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:24.251998 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-75a1c492-a618-437b-9bc7-b91707366711 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:24.302966 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-c1807b93-4534-4592-8232-8594fba90b6a req-90b1bed8-c0ad-4d6e-91dc-3e2cfc02e0fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766f6d20-8985-4a72-b2d7-4062c001c834", "name": "network-vif-plugged", "status": "completed", "tag": "9f04531c-9036-4a8c-96e9-678608518051"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:54:24.313560 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-c1807b93-4534-4592-8232-8594fba90b6a req-90b1bed8-c0ad-4d6e-91dc-3e2cfc02e0fd service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:24.314043 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-c1807b93-4534-4592-8232-8594fba90b6a req-90b1bed8-c0ad-4d6e-91dc-3e2cfc02e0fd service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:24.314478 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-c1807b93-4534-4592-8232-8594fba90b6a req-90b1bed8-c0ad-4d6e-91dc-3e2cfc02e0fd service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:24.332378 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-75a1c492-a618-437b-9bc7-b91707366711 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093223 Aug 12 11:54:24.333406 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 332/657] 10.222.0.42 () {58 vars in 1275 bytes} [Fri Aug 12 11:54:24 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:54:24.334552 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-c1807b93-4534-4592-8232-8594fba90b6a req-90b1bed8-c0ad-4d6e-91dc-3e2cfc02e0fd service nova] Creating event network-vif-plugged:9f04531c-9036-4a8c-96e9-678608518051 for instance 766f6d20-8985-4a72-b2d7-4062c001c834 on hv-cinder-85282 Aug 12 11:54:24.339702 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-c1807b93-4534-4592-8232-8594fba90b6a req-90b1bed8-c0ad-4d6e-91dc-3e2cfc02e0fd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040412 Aug 12 11:54:24.340645 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 326/658] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:54:24.462255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-55632621-ae63-4ebf-b7d9-574c6f10fb06 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:24.462885 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-55632621-ae63-4ebf-b7d9-574c6f10fb06 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:24.469192 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-55632621-ae63-4ebf-b7d9-574c6f10fb06 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:24.469670 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-55632621-ae63-4ebf-b7d9-574c6f10fb06 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:24.470093 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-55632621-ae63-4ebf-b7d9-574c6f10fb06 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:24.470838 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-55632621-ae63-4ebf-b7d9-574c6f10fb06 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:24.471284 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-55632621-ae63-4ebf-b7d9-574c6f10fb06 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:24.471698 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-55632621-ae63-4ebf-b7d9-574c6f10fb06 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:24.605003 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-55632621-ae63-4ebf-b7d9-574c6f10fb06 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:24.613009 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-55632621-ae63-4ebf-b7d9-574c6f10fb06 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1675 microversion: 2.1 time: 0.154625 Aug 12 11:54:24.613574 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 333/659] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:24 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:25.146798 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-09205cf8-f241-4aad-a2cb-544c2c3fb628 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:25.147944 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-09205cf8-f241-4aad-a2cb-544c2c3fb628 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:25.154744 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-09205cf8-f241-4aad-a2cb-544c2c3fb628 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:25.155842 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-09205cf8-f241-4aad-a2cb-544c2c3fb628 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:25.156402 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-09205cf8-f241-4aad-a2cb-544c2c3fb628 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:25.157383 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-09205cf8-f241-4aad-a2cb-544c2c3fb628 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:25.158033 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-09205cf8-f241-4aad-a2cb-544c2c3fb628 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:25.158576 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-09205cf8-f241-4aad-a2cb-544c2c3fb628 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:25.231322 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-1b7f849a-f38e-49ec-a4ca-36d16b64dafa req-141d67db-9ec1-4823-bb6c-aa9c12792cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7545dc36-2c18-434c-94e4-771977a58319", "tag": "b5a1de41-5667-4746-80f9-9707f4939d87"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:54:25.268737 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-1b7f849a-f38e-49ec-a4ca-36d16b64dafa req-141d67db-9ec1-4823-bb6c-aa9c12792cd8 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:25.271244 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-1b7f849a-f38e-49ec-a4ca-36d16b64dafa req-141d67db-9ec1-4823-bb6c-aa9c12792cd8 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:25.271843 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-1b7f849a-f38e-49ec-a4ca-36d16b64dafa req-141d67db-9ec1-4823-bb6c-aa9c12792cd8 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:25.284265 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-1b7f849a-f38e-49ec-a4ca-36d16b64dafa req-141d67db-9ec1-4823-bb6c-aa9c12792cd8 service nova] Creating event network-changed:b5a1de41-5667-4746-80f9-9707f4939d87 for instance 7545dc36-2c18-434c-94e4-771977a58319 on hv-cinder-85282 Aug 12 11:54:25.289088 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-1b7f849a-f38e-49ec-a4ca-36d16b64dafa req-141d67db-9ec1-4823-bb6c-aa9c12792cd8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061622 Aug 12 11:54:25.289650 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 334/660] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:54:25.404957 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-09205cf8-f241-4aad-a2cb-544c2c3fb628 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:25.415674 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-09205cf8-f241-4aad-a2cb-544c2c3fb628 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:25.417185 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-09205cf8-f241-4aad-a2cb-544c2c3fb628 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:25.418314 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-09205cf8-f241-4aad-a2cb-544c2c3fb628 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1406 microversion: 2.20 time: 0.276417 Aug 12 11:54:25.423308 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 327/661] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:54:25 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1406 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:54:25.642109 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-b518c1ef-2e2b-4617-a86e-ea49c63b8fb0 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:25.643060 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-b518c1ef-2e2b-4617-a86e-ea49c63b8fb0 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:25.651774 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b518c1ef-2e2b-4617-a86e-ea49c63b8fb0 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:25.652401 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b518c1ef-2e2b-4617-a86e-ea49c63b8fb0 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:25.652886 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b518c1ef-2e2b-4617-a86e-ea49c63b8fb0 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:25.653759 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b518c1ef-2e2b-4617-a86e-ea49c63b8fb0 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:25.654839 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b518c1ef-2e2b-4617-a86e-ea49c63b8fb0 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:25.655567 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b518c1ef-2e2b-4617-a86e-ea49c63b8fb0 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:25.745253 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-b518c1ef-2e2b-4617-a86e-ea49c63b8fb0 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:25.753945 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-b518c1ef-2e2b-4617-a86e-ea49c63b8fb0 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1607 microversion: 2.1 time: 0.122962 Aug 12 11:54:25.754537 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 335/662] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:25 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1607 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:25.950391 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-f5cc52b0-286a-46b3-978d-6fe68669d0b2 req-16a6de1e-992a-4f8b-bbfa-62a442b38596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dba7589-a4cf-4842-953b-0218eae4d3db", "name": "network-vif-deleted", "tag": "e1b3cbaf-769e-41d6-b51a-8e930b076512"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:54:25.961256 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-f5cc52b0-286a-46b3-978d-6fe68669d0b2 req-16a6de1e-992a-4f8b-bbfa-62a442b38596 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:25.962056 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-f5cc52b0-286a-46b3-978d-6fe68669d0b2 req-16a6de1e-992a-4f8b-bbfa-62a442b38596 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:25.962868 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-f5cc52b0-286a-46b3-978d-6fe68669d0b2 req-16a6de1e-992a-4f8b-bbfa-62a442b38596 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:25.975596 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-f5cc52b0-286a-46b3-978d-6fe68669d0b2 req-16a6de1e-992a-4f8b-bbfa-62a442b38596 service nova] Creating event network-vif-deleted:e1b3cbaf-769e-41d6-b51a-8e930b076512 for instance 6dba7589-a4cf-4842-953b-0218eae4d3db on hv-cinder-85282 Aug 12 11:54:25.981332 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-f5cc52b0-286a-46b3-978d-6fe68669d0b2 req-16a6de1e-992a-4f8b-bbfa-62a442b38596 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034286 Aug 12 11:54:25.982489 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 328/663] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:54:26.441600 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-f5383b21-4339-46eb-89f3-d43b93b61c5c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:26.442209 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-f5383b21-4339-46eb-89f3-d43b93b61c5c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:26.450029 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f5383b21-4339-46eb-89f3-d43b93b61c5c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:26.450863 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f5383b21-4339-46eb-89f3-d43b93b61c5c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:26.451290 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f5383b21-4339-46eb-89f3-d43b93b61c5c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:26.451979 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f5383b21-4339-46eb-89f3-d43b93b61c5c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:26.452449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f5383b21-4339-46eb-89f3-d43b93b61c5c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:26.453042 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f5383b21-4339-46eb-89f3-d43b93b61c5c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:26.587790 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-f5383b21-4339-46eb-89f3-d43b93b61c5c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:26.596299 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-f5383b21-4339-46eb-89f3-d43b93b61c5c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:26.597788 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-f5383b21-4339-46eb-89f3-d43b93b61c5c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:26.598972 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-f5383b21-4339-46eb-89f3-d43b93b61c5c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1599 microversion: 2.20 time: 0.161485 Aug 12 11:54:26.599536 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 336/664] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:54:26 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:54:26.622043 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-a3d9bf8b-c4f9-4c04-bf58-7f9f015dba2a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:26.622642 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-a3d9bf8b-c4f9-4c04-bf58-7f9f015dba2a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:26.628612 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a3d9bf8b-c4f9-4c04-bf58-7f9f015dba2a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:26.629083 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a3d9bf8b-c4f9-4c04-bf58-7f9f015dba2a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:26.629525 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a3d9bf8b-c4f9-4c04-bf58-7f9f015dba2a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:26.630185 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a3d9bf8b-c4f9-4c04-bf58-7f9f015dba2a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:26.630647 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a3d9bf8b-c4f9-4c04-bf58-7f9f015dba2a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:26.631065 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a3d9bf8b-c4f9-4c04-bf58-7f9f015dba2a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:26.709915 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-a3d9bf8b-c4f9-4c04-bf58-7f9f015dba2a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092546 Aug 12 11:54:26.710514 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 329/665] 10.222.0.42 () {60 vars in 1316 bytes} [Fri Aug 12 11:54:26 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 11:54:26.777333 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-835e6ae4-8765-45a6-8cba-2240e29d1bae tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:26.778126 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-835e6ae4-8765-45a6-8cba-2240e29d1bae tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:26.785257 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-835e6ae4-8765-45a6-8cba-2240e29d1bae tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:26.785738 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-835e6ae4-8765-45a6-8cba-2240e29d1bae tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:26.786176 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-835e6ae4-8765-45a6-8cba-2240e29d1bae tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:26.786919 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-835e6ae4-8765-45a6-8cba-2240e29d1bae tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:26.787351 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-835e6ae4-8765-45a6-8cba-2240e29d1bae tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:26.787766 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-835e6ae4-8765-45a6-8cba-2240e29d1bae tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:26.819835 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-835e6ae4-8765-45a6-8cba-2240e29d1bae tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:26.820469 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-835e6ae4-8765-45a6-8cba-2240e29d1bae tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:26.821011 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-835e6ae4-8765-45a6-8cba-2240e29d1bae tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:26.821577 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.objects.instance [None req-835e6ae4-8765-45a6-8cba-2240e29d1bae tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lazy-loading 'fault' on Instance uuid 6dba7589-a4cf-4842-953b-0218eae4d3db {{(pid=132281) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:54:26.899513 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-835e6ae4-8765-45a6-8cba-2240e29d1bae tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:26.909901 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-835e6ae4-8765-45a6-8cba-2240e29d1bae tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 200 len: 1327 microversion: 2.1 time: 0.136364 Aug 12 11:54:26.911176 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 337/666] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:26 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 1327 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:27.304093 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-fbf3f8ff-72ef-4d40-a91a-4d2f4a50d8d6 req-7596bfe1-c7bb-4060-840e-f14ba24483cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7545dc36-2c18-434c-94e4-771977a58319", "tag": "b5a1de41-5667-4746-80f9-9707f4939d87"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:54:27.315020 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-fbf3f8ff-72ef-4d40-a91a-4d2f4a50d8d6 req-7596bfe1-c7bb-4060-840e-f14ba24483cf service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:27.315497 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-fbf3f8ff-72ef-4d40-a91a-4d2f4a50d8d6 req-7596bfe1-c7bb-4060-840e-f14ba24483cf service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:27.315940 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-fbf3f8ff-72ef-4d40-a91a-4d2f4a50d8d6 req-7596bfe1-c7bb-4060-840e-f14ba24483cf service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:27.319851 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=100 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:27.328975 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-fbf3f8ff-72ef-4d40-a91a-4d2f4a50d8d6 req-7596bfe1-c7bb-4060-840e-f14ba24483cf service nova] Creating event network-changed:b5a1de41-5667-4746-80f9-9707f4939d87 for instance 7545dc36-2c18-434c-94e4-771977a58319 on hv-cinder-85282 Aug 12 11:54:27.335393 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-fbf3f8ff-72ef-4d40-a91a-4d2f4a50d8d6 req-7596bfe1-c7bb-4060-840e-f14ba24483cf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034861 Aug 12 11:54:27.335988 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 330/667] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:54:27.932703 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e442cd8f-647f-40ef-b6d6-7fe1fbb45740 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:27.933315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-e442cd8f-647f-40ef-b6d6-7fe1fbb45740 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:27.940494 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e442cd8f-647f-40ef-b6d6-7fe1fbb45740 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:27.940988 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e442cd8f-647f-40ef-b6d6-7fe1fbb45740 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:27.941424 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e442cd8f-647f-40ef-b6d6-7fe1fbb45740 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:27.942118 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e442cd8f-647f-40ef-b6d6-7fe1fbb45740 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:27.942570 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e442cd8f-647f-40ef-b6d6-7fe1fbb45740 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:27.943026 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e442cd8f-647f-40ef-b6d6-7fe1fbb45740 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:27.956902 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.wsgi [None req-e442cd8f-647f-40ef-b6d6-7fe1fbb45740 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] HTTP exception thrown: Instance 6dba7589-a4cf-4842-953b-0218eae4d3db could not be found. Aug 12 11:54:27.958582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e442cd8f-647f-40ef-b6d6-7fe1fbb45740 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Request method failure captured: Aug 12 11:54:27.958582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db HTTP/1.1 Aug 12 11:54:27.958582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 11:54:27.958582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 11:54:27.958582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 11:54:27.958582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 0 Aug 12 11:54:27.958582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 11:54:27.958582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 11:54:27.958582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 11:54:27.958582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 11:54:27.958582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9j5kEfCG-tN23X5w95jn5XkxY3U52DBZ_L0GWoiLWEQzz0WA1BQNDsRTE3earO4rAPrqKy1dBuauP7vnvmUsePhyoKYr-NZgS8VVgWSrEJOc5HIRc9IfmS1urw91oJ3OfbkuwhHgYd8t1t_4wf68AVsAUxRV-GI2tagS77oP14cAJ8U Aug 12 11:54:27.958582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 11:54:27.958582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 11:54:27.958582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 11:54:27.958582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 11:54:27.958582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 11:54:27.958582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 11:54:27.958582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: ecebdd96e25642468903a1657a8ee82d Aug 12 11:54:27.958582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-AttachVolumeTestJSON-265366964 Aug 12 11:54:27.958582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 11:54:27.958582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 11:54:27.960202 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ecebdd96e25642468903a1657a8ee82d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ecebdd96e25642468903a1657a8ee82d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ecebdd96e25642468903a1657a8ee82d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ecebdd96e25642468903a1657a8ee82d"}]}] Aug 12 11:54:27.960202 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-AttachVolumeTestJSON-265366964 Aug 12 11:54:27.960202 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: ecebdd96e25642468903a1657a8ee82d Aug 12 11:54:27.960202 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-AttachVolumeTestJSON-265366964 Aug 12 11:54:27.960202 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-AttachVolumeTestJSON-265366964-project Aug 12 11:54:27.960202 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 11:54:27.960202 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 11:54:27.960202 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: 381f8ca947954e01b6255626d4a2888f Aug 12 11:54:27.960202 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-AttachVolumeTestJSON-265366964-project Aug 12 11:54:27.960202 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: > Aug 12 11:54:27.960202 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Instance 6dba7589-a4cf-4842-953b-0218eae4d3db could not be found. Aug 12 11:54:27.960202 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'id': '6dba7589-a4cf-4842-953b-0218eae4d3db'} Aug 12 11:54:27.961086 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:54:27.961086 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:54:27.961086 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:54:27.961086 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:54:27.961086 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:54:27.961086 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:54:27.961086 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:54:27.961086 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:54:27.961086 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:54:27.961086 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:54:27.961086 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dba7589-a4cf-4842-953b-0218eae4d3db could not be found. Aug 12 11:54:27.961086 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:54:27.961086 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:54:27.961086 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:54:27.961086 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:54:27.961086 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:54:27.961086 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:54:27.961086 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:54:27.961086 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:54:27.961086 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:54:27.962501 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:54:27.962501 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:54:27.962501 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:54:27.962501 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:54:27.962501 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:54:27.962501 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:54:27.962501 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:54:27.962501 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dba7589-a4cf-4842-953b-0218eae4d3db could not be found. Aug 12 11:54:27.962501 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:54:27.962501 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:54:27.962501 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:54:27.962501 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:54:27.962501 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:54:27.962501 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:54:27.962501 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:54:27.962501 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:54:27.962501 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dba7589-a4cf-4842-953b-0218eae4d3db could not be found. Aug 12 11:54:27.962501 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:54:27.964495 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e442cd8f-647f-40ef-b6d6-7fe1fbb45740 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Returning 404 to user: Instance 6dba7589-a4cf-4842-953b-0218eae4d3db could not be found. {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:54:27.965336 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-e442cd8f-647f-40ef-b6d6-7fe1fbb45740 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 404 len: 111 microversion: 2.1 time: 0.036668 Aug 12 11:54:27.965893 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 338/668] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:27 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:54:27.975240 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-40209652-7d51-4ed6-8446-8a0a41be8ede tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '.version_select at 0x7f3e5822d4c0>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:27.996106 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-40209652-7d51-4ed6-8446-8a0a41be8ede tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1210771350" status: 202 len: 0 microversion: 2.1 time: 0.025477 Aug 12 11:54:27.996960 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 331/669] 10.222.0.42 () {58 vars in 1221 bytes} [Fri Aug 12 11:54:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1210771350 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:54:28.500624 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-cd5a885b-b138-4ff2-a58b-0751aa30dfde tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1935729898"}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:54:28.501298 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-cd5a885b-b138-4ff2-a58b-0751aa30dfde tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:28.508592 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cd5a885b-b138-4ff2-a58b-0751aa30dfde tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:28.509066 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cd5a885b-b138-4ff2-a58b-0751aa30dfde tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:28.509492 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cd5a885b-b138-4ff2-a58b-0751aa30dfde tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:28.510193 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cd5a885b-b138-4ff2-a58b-0751aa30dfde tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:28.510867 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cd5a885b-b138-4ff2-a58b-0751aa30dfde tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:28.511440 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cd5a885b-b138-4ff2-a58b-0751aa30dfde tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:28.673752 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-3494ad51-c9f8-482f-b909-20c73755cfb4 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Action: 'create', calling method: .version_select at 0x7f3e58285d30>, body: {"keypair": {"name": "tempest-keypair-1940959568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAHcLgdHuSdNT3IFxMDgEt71YRmjtv3q4ffpt9BVd+785jX6yGZ/bqQSySwMMcJuTvT1KprCOzPjhVx66INbdu3Tv8DHwlK10dBNiCeYx3g+h5fTpoFyk2wfTgeMcGvEw=="}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:54:28.690617 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-3494ad51-c9f8-482f-b909-20c73755cfb4 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Getting quotas for project ecebdd96e25642468903a1657a8ee82d. Resources: {'key_pairs'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:54:28.694750 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-3494ad51-c9f8-482f-b909-20c73755cfb4 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Getting quotas for user 381f8ca947954e01b6255626d4a2888f and project ecebdd96e25642468903a1657a8ee82d. Resources: {'key_pairs'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:54:28.720177 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-3494ad51-c9f8-482f-b909-20c73755cfb4 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050367 Aug 12 11:54:28.721202 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 332/670] 10.222.0.42 () {60 vars in 1159 bytes} [Fri Aug 12 11:54:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:54:28.970327 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.network.security_group_api [None req-cd5a885b-b138-4ff2-a58b-0751aa30dfde tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Removing security group a4635465-08b0-4c93-97b9-0ad3b09b4c99 from port c541547f-b103-4c29-8532-035ca341eb76 Aug 12 11:54:29.374138 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-3706b793-f235-4667-b93f-5740bdfe99b3 req-29ca09a7-81db-4cf2-b336-3c50f781709a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "766f6d20-8985-4a72-b2d7-4062c001c834", "tag": "9f04531c-9036-4a8c-96e9-678608518051"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:54:29.383029 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-cd5a885b-b138-4ff2-a58b-0751aa30dfde tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "POST /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e/action" status: 202 len: 0 microversion: 2.1 time: 0.886828 Aug 12 11:54:29.383804 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 339/671] 10.222.0.42 () {60 vars in 1278 bytes} [Fri Aug 12 11:54:28 2022] POST /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e/action => generated 0 bytes in 889 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:54:29.384796 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-3706b793-f235-4667-b93f-5740bdfe99b3 req-29ca09a7-81db-4cf2-b336-3c50f781709a service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:29.385184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-3706b793-f235-4667-b93f-5740bdfe99b3 req-29ca09a7-81db-4cf2-b336-3c50f781709a service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:29.385609 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-3706b793-f235-4667-b93f-5740bdfe99b3 req-29ca09a7-81db-4cf2-b336-3c50f781709a service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:29.401482 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-3706b793-f235-4667-b93f-5740bdfe99b3 req-29ca09a7-81db-4cf2-b336-3c50f781709a service nova] Creating event network-changed:9f04531c-9036-4a8c-96e9-678608518051 for instance 766f6d20-8985-4a72-b2d7-4062c001c834 on hv-cinder-85282 Aug 12 11:54:29.406751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-3706b793-f235-4667-b93f-5740bdfe99b3 req-29ca09a7-81db-4cf2-b336-3c50f781709a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037034 Aug 12 11:54:29.407839 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 333/672] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:54:29.437543 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-02d523f5-8d42-4116-a136-797635ae408e req-2c07b66e-fc2a-45ec-9fa0-70651e87ff65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e", "tag": "c541547f-b103-4c29-8532-035ca341eb76"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:54:29.452575 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-02d523f5-8d42-4116-a136-797635ae408e req-2c07b66e-fc2a-45ec-9fa0-70651e87ff65 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:29.453720 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-02d523f5-8d42-4116-a136-797635ae408e req-2c07b66e-fc2a-45ec-9fa0-70651e87ff65 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:29.454370 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-02d523f5-8d42-4116-a136-797635ae408e req-2c07b66e-fc2a-45ec-9fa0-70651e87ff65 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:29.475127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-02d523f5-8d42-4116-a136-797635ae408e req-2c07b66e-fc2a-45ec-9fa0-70651e87ff65 service nova] Creating event network-changed:c541547f-b103-4c29-8532-035ca341eb76 for instance 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e on hv-cinder-85282 Aug 12 11:54:29.482134 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-02d523f5-8d42-4116-a136-797635ae408e req-2c07b66e-fc2a-45ec-9fa0-70651e87ff65 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053105 Aug 12 11:54:29.484738 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 340/673] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:54:30.663943 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-0aa7a873-a46a-4aab-9b60-98fe13a9b054 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:30.664575 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-0aa7a873-a46a-4aab-9b60-98fe13a9b054 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:30.671187 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0aa7a873-a46a-4aab-9b60-98fe13a9b054 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:30.671665 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0aa7a873-a46a-4aab-9b60-98fe13a9b054 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:30.672477 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0aa7a873-a46a-4aab-9b60-98fe13a9b054 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:30.672778 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0aa7a873-a46a-4aab-9b60-98fe13a9b054 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:30.673225 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0aa7a873-a46a-4aab-9b60-98fe13a9b054 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:30.674090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0aa7a873-a46a-4aab-9b60-98fe13a9b054 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:30.765623 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.objects.instance [None req-0aa7a873-a46a-4aab-9b60-98fe13a9b054 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lazy-loading 'services' on Instance uuid 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e {{(pid=132282) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:54:30.903643 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-0aa7a873-a46a-4aab-9b60-98fe13a9b054 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "DELETE /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e/os-volume_attachments/a322b6a7-2f9f-4680-89d8-30ba425408dd" status: 202 len: 0 microversion: 2.1 time: 0.244069 Aug 12 11:54:30.904403 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 334/674] 10.222.0.42 () {58 vars in 1416 bytes} [Fri Aug 12 11:54:30 2022] DELETE /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e/os-volume_attachments/a322b6a7-2f9f-4680-89d8-30ba425408dd => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:54:30.915221 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-922fb520-eda7-498a-b773-7e2a110a5e72 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:30.919429 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-922fb520-eda7-498a-b773-7e2a110a5e72 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:30.929278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-922fb520-eda7-498a-b773-7e2a110a5e72 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:30.930631 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-922fb520-eda7-498a-b773-7e2a110a5e72 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:30.931873 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-922fb520-eda7-498a-b773-7e2a110a5e72 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:30.932684 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-922fb520-eda7-498a-b773-7e2a110a5e72 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:30.933730 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-922fb520-eda7-498a-b773-7e2a110a5e72 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:30.934224 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-922fb520-eda7-498a-b773-7e2a110a5e72 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:30.986439 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:31.004660 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-922fb520-eda7-498a-b773-7e2a110a5e72 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094925 Aug 12 11:54:31.005237 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 341/675] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Aug 12 11:54:30 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:54:31.092235 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-8d4ed06f-2ad0-4d3f-aa6f-d3dc15ebf85b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1698409764", "imageRef": "2887ca5b-6aa2-4cc4-a2be-9322a733fc6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a325c0ef-f3fe-4738-9917-23a20123f384"}], "security_groups": [{"name": "tempest-securitygroup--850400813"}], "key_name": "tempest-keypair-1940959568", "user_data": "}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:54:31.195616 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.network.neutron [None req-8d4ed06f-2ad0-4d3f-aa6f-d3dc15ebf85b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] validate_networks() for [('a325c0ef-f3fe-4738-9917-23a20123f384', None, None, None, None, None)] {{(pid=132282) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 11:54:31.421048 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-2cd9df59-7ca4-4a32-91b3-9e0d97bb4a6c req-9aba05b6-d291-4343-8391-f42ccf902a3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e", "tag": "c541547f-b103-4c29-8532-035ca341eb76"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:54:31.431616 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-2cd9df59-7ca4-4a32-91b3-9e0d97bb4a6c req-9aba05b6-d291-4343-8391-f42ccf902a3d service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:31.432361 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-2cd9df59-7ca4-4a32-91b3-9e0d97bb4a6c req-9aba05b6-d291-4343-8391-f42ccf902a3d service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:31.432990 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-2cd9df59-7ca4-4a32-91b3-9e0d97bb4a6c req-9aba05b6-d291-4343-8391-f42ccf902a3d service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:31.444697 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-2cd9df59-7ca4-4a32-91b3-9e0d97bb4a6c req-9aba05b6-d291-4343-8391-f42ccf902a3d service nova] Creating event network-changed:c541547f-b103-4c29-8532-035ca341eb76 for instance 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e on hv-cinder-85282 Aug 12 11:54:31.449546 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-2cd9df59-7ca4-4a32-91b3-9e0d97bb4a6c req-9aba05b6-d291-4343-8391-f42ccf902a3d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032181 Aug 12 11:54:31.450131 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 342/676] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:54:31.618281 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-8d4ed06f-2ad0-4d3f-aa6f-d3dc15ebf85b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Flavor limits 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 11:54:31.619551 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-8d4ed06f-2ad0-4d3f-aa6f-d3dc15ebf85b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Image limits 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 11:54:31.620046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-8d4ed06f-2ad0-4d3f-aa6f-d3dc15ebf85b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Flavor pref 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 11:54:31.620464 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-8d4ed06f-2ad0-4d3f-aa6f-d3dc15ebf85b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Image pref 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 11:54:31.620825 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-8d4ed06f-2ad0-4d3f-aa6f-d3dc15ebf85b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 11:54:31.630743 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8d4ed06f-2ad0-4d3f-aa6f-d3dc15ebf85b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:31.631420 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8d4ed06f-2ad0-4d3f-aa6f-d3dc15ebf85b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:31.632027 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8d4ed06f-2ad0-4d3f-aa6f-d3dc15ebf85b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:31.632919 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8d4ed06f-2ad0-4d3f-aa6f-d3dc15ebf85b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:31.633530 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8d4ed06f-2ad0-4d3f-aa6f-d3dc15ebf85b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:31.634110 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8d4ed06f-2ad0-4d3f-aa6f-d3dc15ebf85b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:31.652778 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-8d4ed06f-2ad0-4d3f-aa6f-d3dc15ebf85b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Getting quotas for project ecebdd96e25642468903a1657a8ee82d. Resources: {'instances', 'ram', 'cores'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:54:31.656777 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-8d4ed06f-2ad0-4d3f-aa6f-d3dc15ebf85b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Getting quotas for user 381f8ca947954e01b6255626d4a2888f and project ecebdd96e25642468903a1657a8ee82d. Resources: {'instances', 'ram', 'cores'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:54:31.668988 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-8d4ed06f-2ad0-4d3f-aa6f-d3dc15ebf85b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Going to run 1 instances... {{(pid=132282) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 11:54:31.671930 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-8d4ed06f-2ad0-4d3f-aa6f-d3dc15ebf85b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2887ca5b-6aa2-4cc4-a2be-9322a733fc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132282) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 11:54:31.719276 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-8d4ed06f-2ad0-4d3f-aa6f-d3dc15ebf85b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.632078 Aug 12 11:54:31.719906 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 335/677] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Aug 12 11:54:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 12 11:54:31.731087 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-6c7e5db7-c197-4991-b11c-7293a6e79873 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:31.731920 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-6c7e5db7-c197-4991-b11c-7293a6e79873 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:31.810539 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-6c7e5db7-c197-4991-b11c-7293a6e79873 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:31.817930 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-6c7e5db7-c197-4991-b11c-7293a6e79873 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e" status: 200 len: 1238 microversion: 2.1 time: 0.090909 Aug 12 11:54:31.818756 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 343/678] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:31 2022] GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e => generated 1238 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:32.019018 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-b9b00d8e-3e20-4693-aef6-ad9562582199 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:32.021503 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-b9b00d8e-3e20-4693-aef6-ad9562582199 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:32.029703 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b9b00d8e-3e20-4693-aef6-ad9562582199 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:32.030264 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b9b00d8e-3e20-4693-aef6-ad9562582199 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:32.030807 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b9b00d8e-3e20-4693-aef6-ad9562582199 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:32.031590 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b9b00d8e-3e20-4693-aef6-ad9562582199 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:32.032127 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b9b00d8e-3e20-4693-aef6-ad9562582199 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:32.032606 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b9b00d8e-3e20-4693-aef6-ad9562582199 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:32.062413 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-b9b00d8e-3e20-4693-aef6-ad9562582199 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048274 Aug 12 11:54:32.063098 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 336/679] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Aug 12 11:54:32 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 11:54:32.074210 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-7b46b11a-6ae6-4c44-afee-c73712da7b4a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:32.075361 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-7b46b11a-6ae6-4c44-afee-c73712da7b4a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:32.081744 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7b46b11a-6ae6-4c44-afee-c73712da7b4a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:32.082231 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7b46b11a-6ae6-4c44-afee-c73712da7b4a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:32.082907 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7b46b11a-6ae6-4c44-afee-c73712da7b4a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:32.083605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7b46b11a-6ae6-4c44-afee-c73712da7b4a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:32.084689 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7b46b11a-6ae6-4c44-afee-c73712da7b4a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:32.085119 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7b46b11a-6ae6-4c44-afee-c73712da7b4a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:32.166920 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.wsgi [None req-7b46b11a-6ae6-4c44-afee-c73712da7b4a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] HTTP exception thrown: Instance 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e is not attached to volume a322b6a7-2f9f-4680-89d8-30ba425408dd Aug 12 11:54:32.169337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-7b46b11a-6ae6-4c44-afee-c73712da7b4a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Request method failure captured: Aug 12 11:54:32.169337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: DELETE /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e/os-volume_attachments/a322b6a7-2f9f-4680-89d8-30ba425408dd HTTP/1.1 Aug 12 11:54:32.169337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 11:54:32.169337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 11:54:32.169337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 11:54:32.169337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 0 Aug 12 11:54:32.169337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 11:54:32.169337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 11:54:32.169337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 11:54:32.169337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 11:54:32.169337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9j7XQpPzYEZ1P1M379Nv3-1cK8kpC2ulHbBu_553tRxeBSJ8l8Th8ZXwQLsMY4akfkm_ti1eXE5ad50OQOl5c8QFLhQrLrALLCAupvdbBbZUcFdB-3YpeMsbozZnnsrBxQaVf_3j24NdTQJo7-yLtt6vvKbYV9vfyZJywLIChcgGGTc Aug 12 11:54:32.169337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 11:54:32.169337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 11:54:32.169337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 11:54:32.169337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 11:54:32.169337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 11:54:32.169337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 11:54:32.169337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: a91d3226406e4f889c7f3abcd37ec490 Aug 12 11:54:32.169337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-TestMinimumBasicScenario-1064803148 Aug 12 11:54:32.169337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 11:54:32.169337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 11:54:32.170820 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a91d3226406e4f889c7f3abcd37ec490", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a91d3226406e4f889c7f3abcd37ec490"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a91d3226406e4f889c7f3abcd37ec490"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a91d3226406e4f889c7f3abcd37ec490"}]}] Aug 12 11:54:32.170820 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-TestMinimumBasicScenario-1064803148 Aug 12 11:54:32.170820 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: a91d3226406e4f889c7f3abcd37ec490 Aug 12 11:54:32.170820 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1064803148 Aug 12 11:54:32.170820 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-TestMinimumBasicScenario-1064803148-project Aug 12 11:54:32.170820 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 11:54:32.170820 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 11:54:32.170820 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: 1227fcf8876a4a0d839c4d9c10626c6e Aug 12 11:54:32.170820 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-TestMinimumBasicScenario-1064803148-project Aug 12 11:54:32.170820 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: > Aug 12 11:54:32.170820 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Instance 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e is not attached to volume a322b6a7-2f9f-4680-89d8-30ba425408dd Aug 12 11:54:32.171590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'server_id': '27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e', 'id': 'a322b6a7-2f9f-4680-89d8-30ba425408dd'} Aug 12 11:54:32.171590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:54:32.171590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:54:32.171590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 12 11:54:32.171590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 12 11:54:32.171590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 11:54:32.171590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 11:54:32.171590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 12 11:54:32.171590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 12 11:54:32.171590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a322b6a7-2f9f-4680-89d8-30ba425408dd. Aug 12 11:54:32.171590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:54:32.171590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:54:32.171590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:54:32.171590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:54:32.171590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:54:32.171590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:54:32.171590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:54:32.171590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:54:32.171590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:54:32.172755 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:54:32.172755 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 12 11:54:32.172755 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 12 11:54:32.172755 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e is not attached to volume a322b6a7-2f9f-4680-89d8-30ba425408dd Aug 12 11:54:32.172755 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:54:32.172755 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:54:32.172755 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:54:32.172755 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:54:32.172755 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:54:32.172755 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:54:32.172755 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:54:32.172755 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:54:32.172755 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e is not attached to volume a322b6a7-2f9f-4680-89d8-30ba425408dd Aug 12 11:54:32.172755 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:54:32.172755 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-7b46b11a-6ae6-4c44-afee-c73712da7b4a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Returning 404 to user: Instance 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e is not attached to volume a322b6a7-2f9f-4680-89d8-30ba425408dd {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:54:32.173846 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-7b46b11a-6ae6-4c44-afee-c73712da7b4a tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "DELETE /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e/os-volume_attachments/a322b6a7-2f9f-4680-89d8-30ba425408dd" status: 404 len: 154 microversion: 2.1 time: 0.100605 Aug 12 11:54:32.173846 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 344/680] 10.222.0.42 () {58 vars in 1416 bytes} [Fri Aug 12 11:54:32 2022] DELETE /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e/os-volume_attachments/a322b6a7-2f9f-4680-89d8-30ba425408dd => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:54:32.838010 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-3941f7c8-eebd-4829-85e0-570f75988ab3 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:32.838785 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-3941f7c8-eebd-4829-85e0-570f75988ab3 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:32.847458 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3941f7c8-eebd-4829-85e0-570f75988ab3 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:32.848020 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3941f7c8-eebd-4829-85e0-570f75988ab3 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:32.848498 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3941f7c8-eebd-4829-85e0-570f75988ab3 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:32.849271 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3941f7c8-eebd-4829-85e0-570f75988ab3 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:32.849786 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3941f7c8-eebd-4829-85e0-570f75988ab3 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:32.850238 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3941f7c8-eebd-4829-85e0-570f75988ab3 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:32.922489 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-3941f7c8-eebd-4829-85e0-570f75988ab3 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:32.929873 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-3941f7c8-eebd-4829-85e0-570f75988ab3 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e" status: 200 len: 1290 microversion: 2.1 time: 0.095758 Aug 12 11:54:32.930433 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 337/681] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:32 2022] GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e => generated 1290 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:33.467108 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e491473b-c03e-45be-a48a-14fba960f9e1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:33.467636 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-e491473b-c03e-45be-a48a-14fba960f9e1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:33.474032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e491473b-c03e-45be-a48a-14fba960f9e1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:33.474514 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e491473b-c03e-45be-a48a-14fba960f9e1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:33.474988 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e491473b-c03e-45be-a48a-14fba960f9e1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:33.475681 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e491473b-c03e-45be-a48a-14fba960f9e1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:33.476130 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e491473b-c03e-45be-a48a-14fba960f9e1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:33.476549 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e491473b-c03e-45be-a48a-14fba960f9e1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:33.502230 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-e491473b-c03e-45be-a48a-14fba960f9e1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Going to try to terminate instance {{(pid=132281) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 11:54:33.581118 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-e491473b-c03e-45be-a48a-14fba960f9e1 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "DELETE /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 204 len: 0 microversion: 2.1 time: 0.117236 Aug 12 11:54:33.584783 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 345/682] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Aug 12 11:54:33 2022] DELETE /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 11:54:33.592263 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-7cd77f3b-413b-4be9-8da6-9c4905d9264d tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:33.592879 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-7cd77f3b-413b-4be9-8da6-9c4905d9264d tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:33.598878 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7cd77f3b-413b-4be9-8da6-9c4905d9264d tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:33.599363 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7cd77f3b-413b-4be9-8da6-9c4905d9264d tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:33.599969 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7cd77f3b-413b-4be9-8da6-9c4905d9264d tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:33.600662 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7cd77f3b-413b-4be9-8da6-9c4905d9264d tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:33.601117 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7cd77f3b-413b-4be9-8da6-9c4905d9264d tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:33.601541 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7cd77f3b-413b-4be9-8da6-9c4905d9264d tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:33.818394 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-7cd77f3b-413b-4be9-8da6-9c4905d9264d tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:33.826742 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-7cd77f3b-413b-4be9-8da6-9c4905d9264d tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1553 microversion: 2.1 time: 0.239712 Aug 12 11:54:33.827448 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 338/683] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:33 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1553 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:33.952947 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-614cf360-a03b-4fc8-8855-90c1d327a84a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:33.953736 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-614cf360-a03b-4fc8-8855-90c1d327a84a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:33.959679 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-614cf360-a03b-4fc8-8855-90c1d327a84a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:33.960169 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-614cf360-a03b-4fc8-8855-90c1d327a84a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:33.960605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-614cf360-a03b-4fc8-8855-90c1d327a84a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:33.961300 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-614cf360-a03b-4fc8-8855-90c1d327a84a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:33.962284 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-614cf360-a03b-4fc8-8855-90c1d327a84a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:33.962284 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-614cf360-a03b-4fc8-8855-90c1d327a84a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:34.205230 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-614cf360-a03b-4fc8-8855-90c1d327a84a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:34.214469 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-614cf360-a03b-4fc8-8855-90c1d327a84a tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e" status: 200 len: 1363 microversion: 2.1 time: 0.265943 Aug 12 11:54:34.215151 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 346/684] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:33 2022] GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:34.857071 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-a83eee08-0c5f-41e8-a919-78f03a02fbb9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:34.858279 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-a83eee08-0c5f-41e8-a919-78f03a02fbb9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:34.867123 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a83eee08-0c5f-41e8-a919-78f03a02fbb9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:34.867607 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a83eee08-0c5f-41e8-a919-78f03a02fbb9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:34.868048 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a83eee08-0c5f-41e8-a919-78f03a02fbb9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:34.868744 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a83eee08-0c5f-41e8-a919-78f03a02fbb9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:34.869195 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a83eee08-0c5f-41e8-a919-78f03a02fbb9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:34.869620 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a83eee08-0c5f-41e8-a919-78f03a02fbb9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:34.999800 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-a83eee08-0c5f-41e8-a919-78f03a02fbb9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:35.007176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-a83eee08-0c5f-41e8-a919-78f03a02fbb9 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1553 microversion: 2.1 time: 0.158550 Aug 12 11:54:35.007741 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 339/685] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:34 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:35.243028 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-da447008-7a16-4bff-ba2a-0d0a452c7c87 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:35.243571 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-da447008-7a16-4bff-ba2a-0d0a452c7c87 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:35.249954 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-da447008-7a16-4bff-ba2a-0d0a452c7c87 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:35.250429 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-da447008-7a16-4bff-ba2a-0d0a452c7c87 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:35.250881 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-da447008-7a16-4bff-ba2a-0d0a452c7c87 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:35.251562 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-da447008-7a16-4bff-ba2a-0d0a452c7c87 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:35.252003 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-da447008-7a16-4bff-ba2a-0d0a452c7c87 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:35.252420 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-da447008-7a16-4bff-ba2a-0d0a452c7c87 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:35.428834 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-da447008-7a16-4bff-ba2a-0d0a452c7c87 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:35.436582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-da447008-7a16-4bff-ba2a-0d0a452c7c87 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e" status: 200 len: 1363 microversion: 2.1 time: 0.197417 Aug 12 11:54:35.437139 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 347/686] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:35 2022] GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:35.914378 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-5e3f47f6-2bbb-4888-a6b4-01338f4048fe tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:35.914890 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-5e3f47f6-2bbb-4888-a6b4-01338f4048fe tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: e6216214-8daa-47dc-88aa-c9af7a623f64] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:35.921407 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5e3f47f6-2bbb-4888-a6b4-01338f4048fe tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:35.921890 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5e3f47f6-2bbb-4888-a6b4-01338f4048fe tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:35.922326 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5e3f47f6-2bbb-4888-a6b4-01338f4048fe tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:35.923779 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5e3f47f6-2bbb-4888-a6b4-01338f4048fe tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:35.924235 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5e3f47f6-2bbb-4888-a6b4-01338f4048fe tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:35.924864 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5e3f47f6-2bbb-4888-a6b4-01338f4048fe tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:35.931471 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-ebed9ecc-583a-49c0-87eb-2e0b75ca5a18 req-4248fe3c-1e2e-4939-a76b-841afd08a3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddc60294-41d7-4e33-8cca-92dc40f56d6e", "tag": "827eeddd-31a3-4650-a207-f6b99b7b49d3"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:54:35.944524 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-ebed9ecc-583a-49c0-87eb-2e0b75ca5a18 req-4248fe3c-1e2e-4939-a76b-841afd08a3c4 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:35.946890 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-ebed9ecc-583a-49c0-87eb-2e0b75ca5a18 req-4248fe3c-1e2e-4939-a76b-841afd08a3c4 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:35.946890 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-ebed9ecc-583a-49c0-87eb-2e0b75ca5a18 req-4248fe3c-1e2e-4939-a76b-841afd08a3c4 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:35.960688 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-ebed9ecc-583a-49c0-87eb-2e0b75ca5a18 req-4248fe3c-1e2e-4939-a76b-841afd08a3c4 service nova] Creating event network-changed:827eeddd-31a3-4650-a207-f6b99b7b49d3 for instance ddc60294-41d7-4e33-8cca-92dc40f56d6e on hv-cinder-85282 Aug 12 11:54:35.965998 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-ebed9ecc-583a-49c0-87eb-2e0b75ca5a18 req-4248fe3c-1e2e-4939-a76b-841afd08a3c4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038420 Aug 12 11:54:35.968271 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 348/687] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:54:35.978494 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-5e3f47f6-2bbb-4888-a6b4-01338f4048fe tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64/ips" status: 200 len: 150 microversion: 2.1 time: 0.067919 Aug 12 11:54:35.979103 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 340/688] 10.222.0.42 () {58 vars in 1248 bytes} [Fri Aug 12 11:54:35 2022] GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64/ips => generated 150 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:54:36.029614 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-52836279-71fb-4acc-8d73-23a5fd9bc001 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:36.030331 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-52836279-71fb-4acc-8d73-23a5fd9bc001 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:36.036497 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-52836279-71fb-4acc-8d73-23a5fd9bc001 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:36.036987 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-52836279-71fb-4acc-8d73-23a5fd9bc001 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:36.037423 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-52836279-71fb-4acc-8d73-23a5fd9bc001 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:36.038123 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-52836279-71fb-4acc-8d73-23a5fd9bc001 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:36.038634 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-52836279-71fb-4acc-8d73-23a5fd9bc001 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:36.039022 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-52836279-71fb-4acc-8d73-23a5fd9bc001 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:36.414109 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-52836279-71fb-4acc-8d73-23a5fd9bc001 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:36.421960 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-52836279-71fb-4acc-8d73-23a5fd9bc001 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1553 microversion: 2.1 time: 0.396975 Aug 12 11:54:36.422532 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 349/689] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:36 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1553 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:36.457887 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-2965b10f-636e-4d60-8c02-4c3782cbd68d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:36.458403 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-2965b10f-636e-4d60-8c02-4c3782cbd68d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:36.464453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2965b10f-636e-4d60-8c02-4c3782cbd68d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:36.464930 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2965b10f-636e-4d60-8c02-4c3782cbd68d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:36.465384 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2965b10f-636e-4d60-8c02-4c3782cbd68d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:36.466063 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2965b10f-636e-4d60-8c02-4c3782cbd68d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:36.466510 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2965b10f-636e-4d60-8c02-4c3782cbd68d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:36.466954 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2965b10f-636e-4d60-8c02-4c3782cbd68d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:36.731130 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-2965b10f-636e-4d60-8c02-4c3782cbd68d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:36.739686 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-2965b10f-636e-4d60-8c02-4c3782cbd68d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e" status: 200 len: 1363 microversion: 2.1 time: 0.285720 Aug 12 11:54:36.740243 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 341/690] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:36 2022] GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e => generated 1363 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:37.348361 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-dfa09922-e288-4480-b6bf-ce81e78c0f31 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8466767c-a770-4958-b329-18d4514e16f3"}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:54:37.350822 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-dfa09922-e288-4480-b6bf-ce81e78c0f31 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: e6216214-8daa-47dc-88aa-c9af7a623f64] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:37.357326 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dfa09922-e288-4480-b6bf-ce81e78c0f31 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:37.357836 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dfa09922-e288-4480-b6bf-ce81e78c0f31 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:37.358267 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dfa09922-e288-4480-b6bf-ce81e78c0f31 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:37.358982 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dfa09922-e288-4480-b6bf-ce81e78c0f31 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:37.359436 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dfa09922-e288-4480-b6bf-ce81e78c0f31 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:37.359898 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dfa09922-e288-4480-b6bf-ce81e78c0f31 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:37.443919 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-7da71212-0f54-447e-b608-aedd1ea893d5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:37.444462 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-7da71212-0f54-447e-b608-aedd1ea893d5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:37.450694 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7da71212-0f54-447e-b608-aedd1ea893d5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:37.451177 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7da71212-0f54-447e-b608-aedd1ea893d5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:37.451615 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7da71212-0f54-447e-b608-aedd1ea893d5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:37.452302 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7da71212-0f54-447e-b608-aedd1ea893d5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:37.452757 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7da71212-0f54-447e-b608-aedd1ea893d5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:37.453184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7da71212-0f54-447e-b608-aedd1ea893d5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:37.567162 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-7da71212-0f54-447e-b608-aedd1ea893d5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227fcf8876a4a0d839c4d9c10626c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91d3226406e4f889c7f3abcd37ec490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:37.574542 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-7da71212-0f54-447e-b608-aedd1ea893d5 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 200 len: 1511 microversion: 2.1 time: 0.134464 Aug 12 11:54:37.575120 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 342/691] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:37 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 1511 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:54:37.762050 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-5085bd22-50bc-49ab-97ea-33d3631c2a52 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:37.762569 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-5085bd22-50bc-49ab-97ea-33d3631c2a52 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:37.768493 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5085bd22-50bc-49ab-97ea-33d3631c2a52 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:37.768972 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5085bd22-50bc-49ab-97ea-33d3631c2a52 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:37.769406 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5085bd22-50bc-49ab-97ea-33d3631c2a52 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:37.770093 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5085bd22-50bc-49ab-97ea-33d3631c2a52 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:37.770541 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5085bd22-50bc-49ab-97ea-33d3631c2a52 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:37.770987 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5085bd22-50bc-49ab-97ea-33d3631c2a52 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:37.905499 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-5085bd22-50bc-49ab-97ea-33d3631c2a52 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:37.913068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-5085bd22-50bc-49ab-97ea-33d3631c2a52 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e" status: 200 len: 1363 microversion: 2.1 time: 0.154932 Aug 12 11:54:37.913680 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 343/692] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:37 2022] GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:54:37.989368 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-d0223d89-f88f-41a3-b216-c36e54a16845 req-102dba97-2ad9-4054-bff5-a0ba7b1cf303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e", "name": "network-vif-deleted", "tag": "c541547f-b103-4c29-8532-035ca341eb76"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:54:38.000947 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-d0223d89-f88f-41a3-b216-c36e54a16845 req-102dba97-2ad9-4054-bff5-a0ba7b1cf303 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:38.001567 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-d0223d89-f88f-41a3-b216-c36e54a16845 req-102dba97-2ad9-4054-bff5-a0ba7b1cf303 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:38.001997 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-d0223d89-f88f-41a3-b216-c36e54a16845 req-102dba97-2ad9-4054-bff5-a0ba7b1cf303 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:38.014671 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-d0223d89-f88f-41a3-b216-c36e54a16845 req-102dba97-2ad9-4054-bff5-a0ba7b1cf303 service nova] Creating event network-vif-deleted:c541547f-b103-4c29-8532-035ca341eb76 for instance 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e on hv-cinder-85282 Aug 12 11:54:38.019829 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-d0223d89-f88f-41a3-b216-c36e54a16845 req-102dba97-2ad9-4054-bff5-a0ba7b1cf303 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034376 Aug 12 11:54:38.020571 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 344/693] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:54:38.100269 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-dfa09922-e288-4480-b6bf-ce81e78c0f31 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "POST /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.755702 Aug 12 11:54:38.101176 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 350/694] 10.222.0.42 () {60 vars in 1323 bytes} [Fri Aug 12 11:54:37 2022] POST /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64/os-volume_attachments => generated 194 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:54:38.600237 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-56905012-c6ca-4bd7-b93f-eb2cac847909 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:38.601375 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-56905012-c6ca-4bd7-b93f-eb2cac847909 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] [instance: 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:38.608666 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-56905012-c6ca-4bd7-b93f-eb2cac847909 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:38.609226 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-56905012-c6ca-4bd7-b93f-eb2cac847909 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:38.609726 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-56905012-c6ca-4bd7-b93f-eb2cac847909 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:38.610699 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-56905012-c6ca-4bd7-b93f-eb2cac847909 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:38.611233 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-56905012-c6ca-4bd7-b93f-eb2cac847909 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:38.611715 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-56905012-c6ca-4bd7-b93f-eb2cac847909 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:38.629666 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.wsgi [None req-56905012-c6ca-4bd7-b93f-eb2cac847909 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] HTTP exception thrown: Instance 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e could not be found. Aug 12 11:54:38.631746 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-56905012-c6ca-4bd7-b93f-eb2cac847909 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Request method failure captured: Aug 12 11:54:38.631746 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e HTTP/1.1 Aug 12 11:54:38.631746 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 11:54:38.631746 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 11:54:38.631746 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 11:54:38.631746 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 0 Aug 12 11:54:38.631746 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 11:54:38.631746 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 11:54:38.631746 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 11:54:38.631746 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 11:54:38.631746 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9j7XQpPzYEZ1P1M379Nv3-1cK8kpC2ulHbBu_553tRxeBSJ8l8Th8ZXwQLsMY4akfkm_ti1eXE5ad50OQOl5c8QFLhQrLrALLCAupvdbBbZUcFdB-3YpeMsbozZnnsrBxQaVf_3j24NdTQJo7-yLtt6vvKbYV9vfyZJywLIChcgGGTc Aug 12 11:54:38.631746 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 11:54:38.631746 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 11:54:38.631746 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 11:54:38.631746 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 11:54:38.631746 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 11:54:38.631746 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 11:54:38.631746 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: a91d3226406e4f889c7f3abcd37ec490 Aug 12 11:54:38.631746 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-TestMinimumBasicScenario-1064803148 Aug 12 11:54:38.631746 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 11:54:38.631746 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 11:54:38.633183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a91d3226406e4f889c7f3abcd37ec490", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a91d3226406e4f889c7f3abcd37ec490"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a91d3226406e4f889c7f3abcd37ec490"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a91d3226406e4f889c7f3abcd37ec490"}]}] Aug 12 11:54:38.633183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-TestMinimumBasicScenario-1064803148 Aug 12 11:54:38.633183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: a91d3226406e4f889c7f3abcd37ec490 Aug 12 11:54:38.633183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1064803148 Aug 12 11:54:38.633183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-TestMinimumBasicScenario-1064803148-project Aug 12 11:54:38.633183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 11:54:38.633183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 11:54:38.633183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: 1227fcf8876a4a0d839c4d9c10626c6e Aug 12 11:54:38.633183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-TestMinimumBasicScenario-1064803148-project Aug 12 11:54:38.633183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: > Aug 12 11:54:38.633183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Instance 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e could not be found. Aug 12 11:54:38.633183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'id': '27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e'} Aug 12 11:54:38.633928 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:54:38.633928 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:54:38.633928 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:54:38.633928 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:54:38.633928 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:54:38.633928 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:54:38.633928 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:54:38.633928 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:54:38.633928 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:54:38.633928 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:54:38.633928 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e could not be found. Aug 12 11:54:38.633928 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:54:38.633928 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:54:38.633928 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:54:38.633928 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:54:38.633928 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:54:38.633928 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:54:38.633928 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:54:38.633928 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:54:38.633928 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:54:38.635435 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:54:38.635435 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:54:38.635435 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:54:38.635435 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:54:38.635435 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:54:38.635435 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:54:38.635435 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:54:38.635435 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e could not be found. Aug 12 11:54:38.635435 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:54:38.635435 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:54:38.635435 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:54:38.635435 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:54:38.635435 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:54:38.635435 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:54:38.635435 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:54:38.635435 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:54:38.635435 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e could not be found. Aug 12 11:54:38.635435 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:54:38.637605 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-56905012-c6ca-4bd7-b93f-eb2cac847909 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Returning 404 to user: Instance 27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e could not be found. {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:54:38.638814 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-56905012-c6ca-4bd7-b93f-eb2cac847909 tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e" status: 404 len: 111 microversion: 2.1 time: 0.045710 Aug 12 11:54:38.639580 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 345/695] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:38 2022] GET /compute/v2.1/servers/27dcdb90-d0b6-4bf9-81c6-22baa2d4f27e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:54:38.649509 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-8d631e6f-c84c-47b9-b5be-aaad762d008f tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] Calling method '.version_select at 0x7f3e580743a0>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:38.670200 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-8d631e6f-c84c-47b9-b5be-aaad762d008f tempest-TestMinimumBasicScenario-1064803148 tempest-TestMinimumBasicScenario-1064803148-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-130283437" status: 202 len: 0 microversion: 2.1 time: 0.024660 Aug 12 11:54:38.673859 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 351/696] 10.222.0.42 () {58 vars in 1269 bytes} [Fri Aug 12 11:54:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-130283437 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:54:38.936625 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-f23912f8-9e84-4b65-bfc5-5f1a65317dc5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:38.937238 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-f23912f8-9e84-4b65-bfc5-5f1a65317dc5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:38.943213 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f23912f8-9e84-4b65-bfc5-5f1a65317dc5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:38.943695 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f23912f8-9e84-4b65-bfc5-5f1a65317dc5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:38.944131 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f23912f8-9e84-4b65-bfc5-5f1a65317dc5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:38.944823 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f23912f8-9e84-4b65-bfc5-5f1a65317dc5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:38.945273 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f23912f8-9e84-4b65-bfc5-5f1a65317dc5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:38.945691 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f23912f8-9e84-4b65-bfc5-5f1a65317dc5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:39.083753 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-f23912f8-9e84-4b65-bfc5-5f1a65317dc5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:39.091436 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-f23912f8-9e84-4b65-bfc5-5f1a65317dc5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e" status: 200 len: 1363 microversion: 2.1 time: 0.158873 Aug 12 11:54:39.092509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 346/697] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:38 2022] GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:40.113287 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-577bcbc7-8eb0-4bf2-aedc-9546f6310aef tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:40.114193 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-577bcbc7-8eb0-4bf2-aedc-9546f6310aef tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:40.121903 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-577bcbc7-8eb0-4bf2-aedc-9546f6310aef tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:40.122390 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-577bcbc7-8eb0-4bf2-aedc-9546f6310aef tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:40.122901 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-577bcbc7-8eb0-4bf2-aedc-9546f6310aef tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:40.123593 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-577bcbc7-8eb0-4bf2-aedc-9546f6310aef tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:40.124209 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-577bcbc7-8eb0-4bf2-aedc-9546f6310aef tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:40.124739 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-577bcbc7-8eb0-4bf2-aedc-9546f6310aef tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:40.265787 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-577bcbc7-8eb0-4bf2-aedc-9546f6310aef tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:40.273201 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-577bcbc7-8eb0-4bf2-aedc-9546f6310aef tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e" status: 200 len: 1363 microversion: 2.1 time: 0.164474 Aug 12 11:54:40.287079 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 352/698] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:40 2022] GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:41.295574 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-74746741-f770-4047-9722-9c23f49a4173 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:41.296178 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-74746741-f770-4047-9722-9c23f49a4173 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:41.303267 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-74746741-f770-4047-9722-9c23f49a4173 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:41.303817 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-74746741-f770-4047-9722-9c23f49a4173 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:41.304259 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-74746741-f770-4047-9722-9c23f49a4173 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:41.304982 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-74746741-f770-4047-9722-9c23f49a4173 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:41.305492 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-74746741-f770-4047-9722-9c23f49a4173 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:41.305964 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-74746741-f770-4047-9722-9c23f49a4173 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:41.472365 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-74746741-f770-4047-9722-9c23f49a4173 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:41.484305 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-74746741-f770-4047-9722-9c23f49a4173 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e" status: 200 len: 1363 microversion: 2.1 time: 0.193467 Aug 12 11:54:41.485812 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 347/699] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:41 2022] GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:42.347135 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-c40bc551-961c-47a7-a38f-eb640509e1ea req-4ee82960-638a-4f02-9d03-bb348d5809b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc60294-41d7-4e33-8cca-92dc40f56d6e", "name": "network-vif-plugged", "status": "completed", "tag": "827eeddd-31a3-4650-a207-f6b99b7b49d3"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:54:42.355479 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell0:SELECT=2 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:42.356590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:42.367160 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-c40bc551-961c-47a7-a38f-eb640509e1ea req-4ee82960-638a-4f02-9d03-bb348d5809b4 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:42.367850 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-c40bc551-961c-47a7-a38f-eb640509e1ea req-4ee82960-638a-4f02-9d03-bb348d5809b4 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:42.368488 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-c40bc551-961c-47a7-a38f-eb640509e1ea req-4ee82960-638a-4f02-9d03-bb348d5809b4 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:42.382826 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-c40bc551-961c-47a7-a38f-eb640509e1ea req-4ee82960-638a-4f02-9d03-bb348d5809b4 service nova] Creating event network-vif-plugged:827eeddd-31a3-4650-a207-f6b99b7b49d3 for instance ddc60294-41d7-4e33-8cca-92dc40f56d6e on hv-cinder-85282 Aug 12 11:54:42.388167 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-c40bc551-961c-47a7-a38f-eb640509e1ea req-4ee82960-638a-4f02-9d03-bb348d5809b4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046372 Aug 12 11:54:42.389020 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 353/700] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:54:42.508560 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-12b52143-dd74-4b28-bf4d-f88e6cef99d6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:42.509314 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-12b52143-dd74-4b28-bf4d-f88e6cef99d6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:42.516004 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=2 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:42.517187 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=10 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:42.521054 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-12b52143-dd74-4b28-bf4d-f88e6cef99d6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:42.521851 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-12b52143-dd74-4b28-bf4d-f88e6cef99d6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:42.522628 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-12b52143-dd74-4b28-bf4d-f88e6cef99d6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:42.523599 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-12b52143-dd74-4b28-bf4d-f88e6cef99d6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:42.524293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-12b52143-dd74-4b28-bf4d-f88e6cef99d6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:42.524925 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-12b52143-dd74-4b28-bf4d-f88e6cef99d6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:43.117597 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-12b52143-dd74-4b28-bf4d-f88e6cef99d6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:43.125601 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-12b52143-dd74-4b28-bf4d-f88e6cef99d6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e" status: 200 len: 1363 microversion: 2.1 time: 0.621586 Aug 12 11:54:43.126102 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 348/701] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:42 2022] GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e => generated 1363 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:44.149780 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-5fd36b03-c2c7-4859-af36-10deeaa9910f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:44.151269 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-5fd36b03-c2c7-4859-af36-10deeaa9910f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:44.158088 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5fd36b03-c2c7-4859-af36-10deeaa9910f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:44.158565 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5fd36b03-c2c7-4859-af36-10deeaa9910f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:44.159419 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5fd36b03-c2c7-4859-af36-10deeaa9910f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:44.160123 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5fd36b03-c2c7-4859-af36-10deeaa9910f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:44.160577 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5fd36b03-c2c7-4859-af36-10deeaa9910f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:44.160991 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5fd36b03-c2c7-4859-af36-10deeaa9910f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:44.381372 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-5fd36b03-c2c7-4859-af36-10deeaa9910f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:44.390402 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-5fd36b03-c2c7-4859-af36-10deeaa9910f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e" status: 200 len: 1363 microversion: 2.1 time: 0.245680 Aug 12 11:54:44.391236 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 354/702] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:44 2022] GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:45.411693 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-ff029d30-f0f7-4f2d-81f6-9ca0d81bf5a5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:45.412234 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-ff029d30-f0f7-4f2d-81f6-9ca0d81bf5a5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:45.418504 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ff029d30-f0f7-4f2d-81f6-9ca0d81bf5a5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:45.419161 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ff029d30-f0f7-4f2d-81f6-9ca0d81bf5a5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:45.419450 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ff029d30-f0f7-4f2d-81f6-9ca0d81bf5a5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:45.420132 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ff029d30-f0f7-4f2d-81f6-9ca0d81bf5a5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:45.420581 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ff029d30-f0f7-4f2d-81f6-9ca0d81bf5a5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:45.421004 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ff029d30-f0f7-4f2d-81f6-9ca0d81bf5a5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:45.627772 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-ff029d30-f0f7-4f2d-81f6-9ca0d81bf5a5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:45.643112 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-ff029d30-f0f7-4f2d-81f6-9ca0d81bf5a5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e" status: 200 len: 1549 microversion: 2.1 time: 0.235214 Aug 12 11:54:45.644507 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 349/703] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:45 2022] GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e => generated 1549 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:45.665146 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-d275794c-5acf-470c-a214-987603bf7bb6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:45.666183 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-d275794c-5acf-470c-a214-987603bf7bb6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:45.673823 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d275794c-5acf-470c-a214-987603bf7bb6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:45.674303 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d275794c-5acf-470c-a214-987603bf7bb6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:45.674753 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d275794c-5acf-470c-a214-987603bf7bb6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:45.675642 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d275794c-5acf-470c-a214-987603bf7bb6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:45.676378 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d275794c-5acf-470c-a214-987603bf7bb6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:45.676945 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d275794c-5acf-470c-a214-987603bf7bb6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:45.767279 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-d275794c-5acf-470c-a214-987603bf7bb6 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105976 Aug 12 11:54:45.768051 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 355/704] 10.222.0.42 () {58 vars in 1275 bytes} [Fri Aug 12 11:54:45 2022] GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:54:46.815648 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-93f85cf6-343e-4436-b979-819a4520a9aa tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8466767c-a770-4958-b329-18d4514e16f3"}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:54:46.818127 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-93f85cf6-343e-4436-b979-819a4520a9aa tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: e6216214-8daa-47dc-88aa-c9af7a623f64] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:46.824819 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-93f85cf6-343e-4436-b979-819a4520a9aa tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:46.826397 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-93f85cf6-343e-4436-b979-819a4520a9aa tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:46.827220 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-93f85cf6-343e-4436-b979-819a4520a9aa tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:46.828088 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-93f85cf6-343e-4436-b979-819a4520a9aa tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:46.828713 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-93f85cf6-343e-4436-b979-819a4520a9aa tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:46.829295 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-93f85cf6-343e-4436-b979-819a4520a9aa tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:46.851595 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-7f18c571-6a8c-48f3-8cf0-f636accd8761 req-3cb06525-b629-496a-b70c-b141c258f800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddc60294-41d7-4e33-8cca-92dc40f56d6e", "tag": "827eeddd-31a3-4650-a207-f6b99b7b49d3"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:54:46.884001 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-7f18c571-6a8c-48f3-8cf0-f636accd8761 req-3cb06525-b629-496a-b70c-b141c258f800 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:46.884699 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-7f18c571-6a8c-48f3-8cf0-f636accd8761 req-3cb06525-b629-496a-b70c-b141c258f800 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:46.885125 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-7f18c571-6a8c-48f3-8cf0-f636accd8761 req-3cb06525-b629-496a-b70c-b141c258f800 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:46.900130 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-7f18c571-6a8c-48f3-8cf0-f636accd8761 req-3cb06525-b629-496a-b70c-b141c258f800 service nova] Creating event network-changed:827eeddd-31a3-4650-a207-f6b99b7b49d3 for instance ddc60294-41d7-4e33-8cca-92dc40f56d6e on hv-cinder-85282 Aug 12 11:54:46.906059 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-7f18c571-6a8c-48f3-8cf0-f636accd8761 req-3cb06525-b629-496a-b70c-b141c258f800 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058617 Aug 12 11:54:46.907112 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 356/705] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:54:46.934314 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.wsgi [None req-93f85cf6-343e-4436-b979-819a4520a9aa tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] HTTP exception thrown: Invalid volume: volume 8466767c-a770-4958-b329-18d4514e16f3 is already attached to instances: e6216214-8daa-47dc-88aa-c9af7a623f64 Aug 12 11:54:46.937218 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-93f85cf6-343e-4436-b979-819a4520a9aa tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Request method failure captured: Aug 12 11:54:46.937218 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: POST /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64/os-volume_attachments HTTP/1.1 Aug 12 11:54:46.937218 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 11:54:46.937218 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 11:54:46.937218 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 11:54:46.937218 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 74 Aug 12 11:54:46.937218 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 11:54:46.937218 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 11:54:46.937218 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 11:54:46.937218 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 11:54:46.937218 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9j5b93D9DFn6geUGIXSqCWNPRsOoFCQh7K0YJu6U1z8M-82hV_MMW-0Rx_RsrS3lVH4yCHqvGV-EIGSy6uHXvN26xND935rxaQQze8S1cibmQ_P5YQQSOUKlcTJjvmH8tXnzK6aYRsotianp-i1gOUOwU_1_GVtqTppajmycDWrHY6k Aug 12 11:54:46.937218 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 11:54:46.937218 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 11:54:46.937218 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 11:54:46.937218 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 11:54:46.937218 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 11:54:46.937218 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 11:54:46.937218 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: 8299891a8d134af4be3f84cdc7abec51 Aug 12 11:54:46.937218 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:54:46.937218 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 11:54:46.937218 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 11:54:46.939113 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8299891a8d134af4be3f84cdc7abec51", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8299891a8d134af4be3f84cdc7abec51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8299891a8d134af4be3f84cdc7abec51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8299891a8d134af4be3f84cdc7abec51"}]}] Aug 12 11:54:46.939113 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:54:46.939113 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: 8299891a8d134af4be3f84cdc7abec51 Aug 12 11:54:46.939113 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:54:46.939113 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-AttachVolumeNegativeTest-1716385367-project Aug 12 11:54:46.939113 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 11:54:46.939113 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 11:54:46.939113 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: 72a30400dec14a85889af8d8dd59886e Aug 12 11:54:46.939113 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-AttachVolumeNegativeTest-1716385367-project Aug 12 11:54:46.939113 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Aug 12 11:54:46.939113 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {"volumeAttachment": {"volumeId": "8466767c-a770-4958-b329-18d4514e16f3"}} Aug 12 11:54:46.939113 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: > Aug 12 11:54:46.940026 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Invalid volume: volume 8466767c-a770-4958-b329-18d4514e16f3 is already attached to instances: e6216214-8daa-47dc-88aa-c9af7a623f64 Aug 12 11:54:46.940026 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'server_id': 'e6216214-8daa-47dc-88aa-c9af7a623f64', 'body': {'volumeAttachment': {'volumeId': '8466767c-a770-4958-b329-18d4514e16f3'}}} Aug 12 11:54:46.940026 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:54:46.940026 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:54:46.940026 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 12 11:54:46.940026 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 12 11:54:46.940026 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 12 11:54:46.940026 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 12 11:54:46.940026 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 12 11:54:46.940026 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 12 11:54:46.940026 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 12 11:54:46.940026 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 12 11:54:46.940026 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 12 11:54:46.940026 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 12 11:54:46.940026 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8466767c-a770-4958-b329-18d4514e16f3 is already attached to instances: e6216214-8daa-47dc-88aa-c9af7a623f64 Aug 12 11:54:46.940026 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:54:46.940026 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:54:46.940026 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:54:46.940026 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:54:46.941580 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:54:46.941580 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:54:46.941580 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:54:46.941580 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:54:46.941580 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:54:46.941580 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:54:46.941580 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 11:54:46.941580 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 11:54:46.941580 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 11:54:46.941580 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 11:54:46.941580 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 11:54:46.941580 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 11:54:46.941580 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 12 11:54:46.941580 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 12 11:54:46.941580 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8466767c-a770-4958-b329-18d4514e16f3 is already attached to instances: e6216214-8daa-47dc-88aa-c9af7a623f64 Aug 12 11:54:46.941580 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:54:46.941580 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:54:46.941580 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:54:46.941580 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:54:46.941580 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:54:46.943061 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:54:46.943061 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:54:46.943061 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:54:46.943061 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8466767c-a770-4958-b329-18d4514e16f3 is already attached to instances: e6216214-8daa-47dc-88aa-c9af7a623f64 Aug 12 11:54:46.943061 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:54:46.943061 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-93f85cf6-343e-4436-b979-819a4520a9aa tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Returning 400 to user: Invalid volume: volume 8466767c-a770-4958-b329-18d4514e16f3 is already attached to instances: e6216214-8daa-47dc-88aa-c9af7a623f64 {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:54:46.943061 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-93f85cf6-343e-4436-b979-819a4520a9aa tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "POST /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.127264 Aug 12 11:54:46.943061 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 350/706] 10.222.0.42 () {60 vars in 1323 bytes} [Fri Aug 12 11:54:46 2022] POST /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64/os-volume_attachments => generated 174 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 12 11:54:47.019642 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-b9778c69-783f-48ec-8fd9-dc378873d805 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:47.020397 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-b9778c69-783f-48ec-8fd9-dc378873d805 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: e6216214-8daa-47dc-88aa-c9af7a623f64] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:47.026986 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b9778c69-783f-48ec-8fd9-dc378873d805 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:47.027655 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b9778c69-783f-48ec-8fd9-dc378873d805 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:47.028267 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b9778c69-783f-48ec-8fd9-dc378873d805 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:47.029103 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b9778c69-783f-48ec-8fd9-dc378873d805 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:47.029702 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b9778c69-783f-48ec-8fd9-dc378873d805 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:47.030269 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b9778c69-783f-48ec-8fd9-dc378873d805 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:47.134221 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.objects.instance [None req-b9778c69-783f-48ec-8fd9-dc378873d805 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lazy-loading 'services' on Instance uuid e6216214-8daa-47dc-88aa-c9af7a623f64 {{(pid=132281) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:54:47.230653 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-b9778c69-783f-48ec-8fd9-dc378873d805 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64/os-volume_attachments/8466767c-a770-4958-b329-18d4514e16f3" status: 202 len: 0 microversion: 2.1 time: 0.221332 Aug 12 11:54:47.235454 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 357/707] 10.222.0.42 () {58 vars in 1416 bytes} [Fri Aug 12 11:54:47 2022] DELETE /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64/os-volume_attachments/8466767c-a770-4958-b329-18d4514e16f3 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:54:47.241530 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-415fe0b2-0d16-43ae-8f86-334fb30c63be tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:47.244640 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-415fe0b2-0d16-43ae-8f86-334fb30c63be tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: e6216214-8daa-47dc-88aa-c9af7a623f64] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:47.271757 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-415fe0b2-0d16-43ae-8f86-334fb30c63be tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:47.272516 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-415fe0b2-0d16-43ae-8f86-334fb30c63be tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:47.272954 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-415fe0b2-0d16-43ae-8f86-334fb30c63be tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:47.274955 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-415fe0b2-0d16-43ae-8f86-334fb30c63be tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:47.278969 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-415fe0b2-0d16-43ae-8f86-334fb30c63be tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:47.280408 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-415fe0b2-0d16-43ae-8f86-334fb30c63be tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:47.333435 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:47.340530 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-415fe0b2-0d16-43ae-8f86-334fb30c63be tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103980 Aug 12 11:54:47.345815 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 351/708] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Aug 12 11:54:47 2022] GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:54:48.354283 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-161557f6-7d09-4f06-8f34-8b51715ac977 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:48.356609 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-161557f6-7d09-4f06-8f34-8b51715ac977 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: e6216214-8daa-47dc-88aa-c9af7a623f64] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:48.362840 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-161557f6-7d09-4f06-8f34-8b51715ac977 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:48.363314 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-161557f6-7d09-4f06-8f34-8b51715ac977 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:48.363745 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-161557f6-7d09-4f06-8f34-8b51715ac977 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:48.364428 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-161557f6-7d09-4f06-8f34-8b51715ac977 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:48.364879 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-161557f6-7d09-4f06-8f34-8b51715ac977 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:48.365301 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-161557f6-7d09-4f06-8f34-8b51715ac977 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:48.395565 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-161557f6-7d09-4f06-8f34-8b51715ac977 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046147 Aug 12 11:54:48.396127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 358/709] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Aug 12 11:54:48 2022] GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:54:49.409031 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-0130cee3-be16-47a0-813e-9de6222f853e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:49.411239 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-0130cee3-be16-47a0-813e-9de6222f853e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: e6216214-8daa-47dc-88aa-c9af7a623f64] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:49.417741 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0130cee3-be16-47a0-813e-9de6222f853e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:49.418226 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0130cee3-be16-47a0-813e-9de6222f853e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:49.418699 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0130cee3-be16-47a0-813e-9de6222f853e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:49.419396 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0130cee3-be16-47a0-813e-9de6222f853e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:49.419848 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0130cee3-be16-47a0-813e-9de6222f853e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:49.420280 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0130cee3-be16-47a0-813e-9de6222f853e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:49.448930 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-0130cee3-be16-47a0-813e-9de6222f853e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044948 Aug 12 11:54:49.449485 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 352/710] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Aug 12 11:54:49 2022] GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 11:54:49.511172 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-7a1b7771-23a3-42f1-ae9d-b971ca09aa63 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:49.511643 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-7a1b7771-23a3-42f1-ae9d-b971ca09aa63 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: e6216214-8daa-47dc-88aa-c9af7a623f64] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:49.518391 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7a1b7771-23a3-42f1-ae9d-b971ca09aa63 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:49.518897 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7a1b7771-23a3-42f1-ae9d-b971ca09aa63 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:49.519329 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7a1b7771-23a3-42f1-ae9d-b971ca09aa63 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:49.520014 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7a1b7771-23a3-42f1-ae9d-b971ca09aa63 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:49.520462 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7a1b7771-23a3-42f1-ae9d-b971ca09aa63 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:49.520879 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7a1b7771-23a3-42f1-ae9d-b971ca09aa63 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:49.539214 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:49.546835 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-7a1b7771-23a3-42f1-ae9d-b971ca09aa63 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: e6216214-8daa-47dc-88aa-c9af7a623f64] Going to try to terminate instance {{(pid=132281) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 11:54:49.626450 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-7a1b7771-23a3-42f1-ae9d-b971ca09aa63 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64" status: 204 len: 0 microversion: 2.1 time: 0.118136 Aug 12 11:54:49.627126 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 359/711] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Aug 12 11:54:49 2022] DELETE /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 11:54:49.635990 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-7c99f26a-5d48-4630-93ba-11a3031edd6e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:49.636605 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-7c99f26a-5d48-4630-93ba-11a3031edd6e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: e6216214-8daa-47dc-88aa-c9af7a623f64] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:49.644435 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7c99f26a-5d48-4630-93ba-11a3031edd6e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:49.645031 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7c99f26a-5d48-4630-93ba-11a3031edd6e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:49.645497 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7c99f26a-5d48-4630-93ba-11a3031edd6e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:49.646195 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7c99f26a-5d48-4630-93ba-11a3031edd6e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:49.646690 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7c99f26a-5d48-4630-93ba-11a3031edd6e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:49.647115 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7c99f26a-5d48-4630-93ba-11a3031edd6e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:49.774294 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-7c99f26a-5d48-4630-93ba-11a3031edd6e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:49.781910 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-7c99f26a-5d48-4630-93ba-11a3031edd6e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64" status: 200 len: 1682 microversion: 2.1 time: 0.149776 Aug 12 11:54:49.782484 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 353/712] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:49 2022] GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:54:50.803789 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-9ded9936-e655-4731-8e60-1f5371309797 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:50.804475 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-9ded9936-e655-4731-8e60-1f5371309797 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: e6216214-8daa-47dc-88aa-c9af7a623f64] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:50.811899 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9ded9936-e655-4731-8e60-1f5371309797 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:50.812411 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9ded9936-e655-4731-8e60-1f5371309797 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:50.812838 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9ded9936-e655-4731-8e60-1f5371309797 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:50.813540 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9ded9936-e655-4731-8e60-1f5371309797 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:50.813987 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9ded9936-e655-4731-8e60-1f5371309797 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:50.814399 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9ded9936-e655-4731-8e60-1f5371309797 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:50.946972 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-9ded9936-e655-4731-8e60-1f5371309797 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:50.954414 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-9ded9936-e655-4731-8e60-1f5371309797 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64" status: 200 len: 1682 microversion: 2.1 time: 0.154859 Aug 12 11:54:50.955001 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 360/713] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:50 2022] GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:51.975833 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e7f72ab0-b05e-4096-9720-02badb26885d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:51.976436 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-e7f72ab0-b05e-4096-9720-02badb26885d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: e6216214-8daa-47dc-88aa-c9af7a623f64] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:51.982944 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e7f72ab0-b05e-4096-9720-02badb26885d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:51.983847 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e7f72ab0-b05e-4096-9720-02badb26885d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:51.983847 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e7f72ab0-b05e-4096-9720-02badb26885d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:51.984519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e7f72ab0-b05e-4096-9720-02badb26885d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:51.984966 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e7f72ab0-b05e-4096-9720-02badb26885d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:51.985391 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e7f72ab0-b05e-4096-9720-02badb26885d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:52.202022 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e7f72ab0-b05e-4096-9720-02badb26885d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:52.209574 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e7f72ab0-b05e-4096-9720-02badb26885d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64" status: 200 len: 1682 microversion: 2.1 time: 0.237608 Aug 12 11:54:52.210138 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 354/714] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:51 2022] GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64 => generated 1682 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:54:52.566911 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-08c40efd-c48f-4d2f-8f66-2cda8d7261ec req-dc0d845f-9cac-4ae8-a381-b14ba2817475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6216214-8daa-47dc-88aa-c9af7a623f64", "name": "network-vif-deleted", "tag": "de15eac7-57e7-484d-9446-6737d3a47b8d"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:54:52.577553 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-08c40efd-c48f-4d2f-8f66-2cda8d7261ec req-dc0d845f-9cac-4ae8-a381-b14ba2817475 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:52.578029 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-08c40efd-c48f-4d2f-8f66-2cda8d7261ec req-dc0d845f-9cac-4ae8-a381-b14ba2817475 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:52.578456 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-08c40efd-c48f-4d2f-8f66-2cda8d7261ec req-dc0d845f-9cac-4ae8-a381-b14ba2817475 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:52.592061 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-08c40efd-c48f-4d2f-8f66-2cda8d7261ec req-dc0d845f-9cac-4ae8-a381-b14ba2817475 service nova] Creating event network-vif-deleted:de15eac7-57e7-484d-9446-6737d3a47b8d for instance e6216214-8daa-47dc-88aa-c9af7a623f64 on hv-cinder-85282 Aug 12 11:54:52.597271 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-08c40efd-c48f-4d2f-8f66-2cda8d7261ec req-dc0d845f-9cac-4ae8-a381-b14ba2817475 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033876 Aug 12 11:54:52.598836 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 361/715] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:54:53.231358 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-6a076cd8-b6dd-4361-9479-c10e5670f5ae tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:53.232538 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-6a076cd8-b6dd-4361-9479-c10e5670f5ae tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: e6216214-8daa-47dc-88aa-c9af7a623f64] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:53.235033 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:53.240347 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6a076cd8-b6dd-4361-9479-c10e5670f5ae tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:53.240840 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6a076cd8-b6dd-4361-9479-c10e5670f5ae tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:53.241284 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6a076cd8-b6dd-4361-9479-c10e5670f5ae tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:53.242017 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6a076cd8-b6dd-4361-9479-c10e5670f5ae tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:53.242476 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6a076cd8-b6dd-4361-9479-c10e5670f5ae tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:53.242929 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6a076cd8-b6dd-4361-9479-c10e5670f5ae tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:53.258923 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.wsgi [None req-6a076cd8-b6dd-4361-9479-c10e5670f5ae tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] HTTP exception thrown: Instance e6216214-8daa-47dc-88aa-c9af7a623f64 could not be found. Aug 12 11:54:53.260472 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-6a076cd8-b6dd-4361-9479-c10e5670f5ae tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Request method failure captured: Aug 12 11:54:53.260472 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64 HTTP/1.1 Aug 12 11:54:53.260472 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 11:54:53.260472 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 11:54:53.260472 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 11:54:53.260472 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 0 Aug 12 11:54:53.260472 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 11:54:53.260472 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 11:54:53.260472 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 11:54:53.260472 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 11:54:53.260472 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9j5b93D9DFn6geUGIXSqCWNPRsOoFCQh7K0YJu6U1z8M-82hV_MMW-0Rx_RsrS3lVH4yCHqvGV-EIGSy6uHXvN26xND935rxaQQze8S1cibmQ_P5YQQSOUKlcTJjvmH8tXnzK6aYRsotianp-i1gOUOwU_1_GVtqTppajmycDWrHY6k Aug 12 11:54:53.260472 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 11:54:53.260472 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 11:54:53.260472 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 11:54:53.260472 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 11:54:53.260472 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 11:54:53.260472 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 11:54:53.260472 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: 8299891a8d134af4be3f84cdc7abec51 Aug 12 11:54:53.260472 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:54:53.260472 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 11:54:53.260472 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 11:54:53.261950 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8299891a8d134af4be3f84cdc7abec51", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8299891a8d134af4be3f84cdc7abec51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8299891a8d134af4be3f84cdc7abec51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8299891a8d134af4be3f84cdc7abec51"}]}] Aug 12 11:54:53.261950 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:54:53.261950 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: 8299891a8d134af4be3f84cdc7abec51 Aug 12 11:54:53.261950 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:54:53.261950 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-AttachVolumeNegativeTest-1716385367-project Aug 12 11:54:53.261950 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 11:54:53.261950 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 11:54:53.261950 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: 72a30400dec14a85889af8d8dd59886e Aug 12 11:54:53.261950 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-AttachVolumeNegativeTest-1716385367-project Aug 12 11:54:53.261950 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: > Aug 12 11:54:53.261950 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Instance e6216214-8daa-47dc-88aa-c9af7a623f64 could not be found. Aug 12 11:54:53.261950 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'id': 'e6216214-8daa-47dc-88aa-c9af7a623f64'} Aug 12 11:54:53.263176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:54:53.263176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:54:53.263176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:54:53.263176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:54:53.263176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:54:53.263176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:54:53.263176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:54:53.263176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:54:53.263176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:54:53.263176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:54:53.263176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6216214-8daa-47dc-88aa-c9af7a623f64 could not be found. Aug 12 11:54:53.263176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:54:53.263176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:54:53.263176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:54:53.263176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:54:53.263176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:54:53.263176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:54:53.263176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:54:53.263176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:54:53.263176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:54:53.264595 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:54:53.264595 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:54:53.264595 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:54:53.264595 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:54:53.264595 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:54:53.264595 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:54:53.264595 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:54:53.264595 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6216214-8daa-47dc-88aa-c9af7a623f64 could not be found. Aug 12 11:54:53.264595 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:54:53.264595 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:54:53.264595 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:54:53.264595 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:54:53.264595 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:54:53.264595 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:54:53.264595 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:54:53.264595 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:54:53.264595 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6216214-8daa-47dc-88aa-c9af7a623f64 could not be found. Aug 12 11:54:53.264595 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:54:53.265830 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-6a076cd8-b6dd-4361-9479-c10e5670f5ae tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Returning 404 to user: Instance e6216214-8daa-47dc-88aa-c9af7a623f64 could not be found. {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:54:53.265830 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-6a076cd8-b6dd-4361-9479-c10e5670f5ae tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64" status: 404 len: 111 microversion: 2.1 time: 0.034383 Aug 12 11:54:53.265830 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 355/716] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:53 2022] GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:54:53.271418 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-94684f76-82a4-4bed-809d-6ad9bb0da7a9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '.version_select at 0x7f3e5820a4c0>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:53.290108 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-94684f76-82a4-4bed-809d-6ad9bb0da7a9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-952718840" status: 202 len: 0 microversion: 2.1 time: 0.022896 Aug 12 11:54:53.290694 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 362/717] 10.222.0.42 () {58 vars in 1218 bytes} [Fri Aug 12 11:54:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-952718840 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:54:53.894160 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-7c049d49-65ed-4b1e-95a0-40eef0bd3149 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Action: 'create', calling method: .version_select at 0x7f3e58361940>, body: {"keypair": {"name": "tempest-keypair-27166005", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKDoGsGMlTRDJABzsUjuyzwg9/nWYv/advice8Ncosyve+6OrBOkvo9TorbJFz8Xc4SEgSRFMHf+mScARiMJ+Ye57kdim1Yt8B/Ihdbfle/bU3wyeatqSLuMkEGZRwnSw=="}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:54:53.909266 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-7c049d49-65ed-4b1e-95a0-40eef0bd3149 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Getting quotas for project 8299891a8d134af4be3f84cdc7abec51. Resources: {'key_pairs'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:54:53.913060 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-7c049d49-65ed-4b1e-95a0-40eef0bd3149 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Getting quotas for user 72a30400dec14a85889af8d8dd59886e and project 8299891a8d134af4be3f84cdc7abec51. Resources: {'key_pairs'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:54:53.936013 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-7c049d49-65ed-4b1e-95a0-40eef0bd3149 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.044977 Aug 12 11:54:53.936593 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 356/718] 10.222.0.42 () {60 vars in 1159 bytes} [Fri Aug 12 11:54:53 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:54:55.432756 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-d9917b1f-05c8-43c8-8c37-7dc4b866522e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1161738336", "imageRef": "2887ca5b-6aa2-4cc4-a2be-9322a733fc6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7833e310-6d60-47b5-8e0a-4784db7aa59d"}], "security_groups": [{"name": "tempest-securitygroup--1206406462"}], "key_name": "tempest-keypair-27166005", "user_data": "}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:54:55.534196 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.network.neutron [None req-d9917b1f-05c8-43c8-8c37-7dc4b866522e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] validate_networks() for [('7833e310-6d60-47b5-8e0a-4784db7aa59d', None, None, None, None, None)] {{(pid=132281) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 11:54:55.889279 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-d9917b1f-05c8-43c8-8c37-7dc4b866522e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Flavor limits 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 11:54:55.889693 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-d9917b1f-05c8-43c8-8c37-7dc4b866522e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Image limits 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 11:54:55.890160 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-d9917b1f-05c8-43c8-8c37-7dc4b866522e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Flavor pref 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 11:54:55.890588 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-d9917b1f-05c8-43c8-8c37-7dc4b866522e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Image pref 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 11:54:55.891021 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-d9917b1f-05c8-43c8-8c37-7dc4b866522e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 11:54:55.899697 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d9917b1f-05c8-43c8-8c37-7dc4b866522e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:55.900182 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d9917b1f-05c8-43c8-8c37-7dc4b866522e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:55.900602 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d9917b1f-05c8-43c8-8c37-7dc4b866522e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:55.901314 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d9917b1f-05c8-43c8-8c37-7dc4b866522e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:55.901760 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d9917b1f-05c8-43c8-8c37-7dc4b866522e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:55.902177 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d9917b1f-05c8-43c8-8c37-7dc4b866522e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:55.918901 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.quota [None req-d9917b1f-05c8-43c8-8c37-7dc4b866522e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Getting quotas for project 8299891a8d134af4be3f84cdc7abec51. Resources: {'instances', 'ram', 'cores'} {{(pid=132281) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:54:55.923336 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.quota [None req-d9917b1f-05c8-43c8-8c37-7dc4b866522e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Getting quotas for user 72a30400dec14a85889af8d8dd59886e and project 8299891a8d134af4be3f84cdc7abec51. Resources: {'instances', 'ram', 'cores'} {{(pid=132281) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:54:55.933979 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-d9917b1f-05c8-43c8-8c37-7dc4b866522e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Going to run 1 instances... {{(pid=132281) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 11:54:55.936588 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-d9917b1f-05c8-43c8-8c37-7dc4b866522e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2887ca5b-6aa2-4cc4-a2be-9322a733fc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132281) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 11:54:55.984688 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-d9917b1f-05c8-43c8-8c37-7dc4b866522e tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.556176 Aug 12 11:54:55.985341 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 363/719] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Aug 12 11:54:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 11:54:55.996628 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-eb743070-7711-48e8-84b7-1cd8fa3c63f5 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:55.997238 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-eb743070-7711-48e8-84b7-1cd8fa3c63f5 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:56.053426 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-eb743070-7711-48e8-84b7-1cd8fa3c63f5 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:56.060323 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-eb743070-7711-48e8-84b7-1cd8fa3c63f5 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8" status: 200 len: 1240 microversion: 2.1 time: 0.067753 Aug 12 11:54:56.060884 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 357/720] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:55 2022] GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:57.082502 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-c62f476a-8f2f-4540-8c38-2a06b33191c9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:57.083136 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-c62f476a-8f2f-4540-8c38-2a06b33191c9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:57.090151 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c62f476a-8f2f-4540-8c38-2a06b33191c9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:57.090841 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c62f476a-8f2f-4540-8c38-2a06b33191c9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:57.091926 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c62f476a-8f2f-4540-8c38-2a06b33191c9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:57.092694 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c62f476a-8f2f-4540-8c38-2a06b33191c9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:57.093256 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c62f476a-8f2f-4540-8c38-2a06b33191c9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:57.093718 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c62f476a-8f2f-4540-8c38-2a06b33191c9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:57.183173 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-c62f476a-8f2f-4540-8c38-2a06b33191c9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:57.192743 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-c62f476a-8f2f-4540-8c38-2a06b33191c9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8" status: 200 len: 1300 microversion: 2.1 time: 0.114734 Aug 12 11:54:57.193615 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 364/721] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:57 2022] GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8 => generated 1300 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:58.214908 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-9a7f8c92-7c2c-428f-8dcc-a015499a58a7 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:58.215514 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-9a7f8c92-7c2c-428f-8dcc-a015499a58a7 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:58.221930 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9a7f8c92-7c2c-428f-8dcc-a015499a58a7 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:58.222409 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9a7f8c92-7c2c-428f-8dcc-a015499a58a7 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:58.222941 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9a7f8c92-7c2c-428f-8dcc-a015499a58a7 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:58.223626 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9a7f8c92-7c2c-428f-8dcc-a015499a58a7 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:58.224070 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9a7f8c92-7c2c-428f-8dcc-a015499a58a7 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:58.224682 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9a7f8c92-7c2c-428f-8dcc-a015499a58a7 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:58.470199 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-9a7f8c92-7c2c-428f-8dcc-a015499a58a7 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:58.477559 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-9a7f8c92-7c2c-428f-8dcc-a015499a58a7 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8" status: 200 len: 1366 microversion: 2.1 time: 0.266573 Aug 12 11:54:58.478155 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 358/722] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:58 2022] GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8 => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:54:58.615176 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-1bceb915-db8f-4083-a59d-53c25ac0d450 req-cf82b6a9-fd55-44af-90cd-326b1e2fa2bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15bed11d-dd0b-4cc8-ab40-968fdf8689c8", "tag": "74085585-4c60-4395-8719-be2205ab20cc"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:54:58.627284 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-1bceb915-db8f-4083-a59d-53c25ac0d450 req-cf82b6a9-fd55-44af-90cd-326b1e2fa2bc service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:58.627896 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-1bceb915-db8f-4083-a59d-53c25ac0d450 req-cf82b6a9-fd55-44af-90cd-326b1e2fa2bc service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:58.628732 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-1bceb915-db8f-4083-a59d-53c25ac0d450 req-cf82b6a9-fd55-44af-90cd-326b1e2fa2bc service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:58.640751 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-1bceb915-db8f-4083-a59d-53c25ac0d450 req-cf82b6a9-fd55-44af-90cd-326b1e2fa2bc service nova] Creating event network-changed:74085585-4c60-4395-8719-be2205ab20cc for instance 15bed11d-dd0b-4cc8-ab40-968fdf8689c8 on hv-cinder-85282 Aug 12 11:54:58.645398 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-1bceb915-db8f-4083-a59d-53c25ac0d450 req-cf82b6a9-fd55-44af-90cd-326b1e2fa2bc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033852 Aug 12 11:54:58.645994 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 365/723] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:54:59.499306 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-b695585b-4b54-49aa-a18e-cbb011d079c8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:54:59.499919 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-b695585b-4b54-49aa-a18e-cbb011d079c8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:54:59.506290 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b695585b-4b54-49aa-a18e-cbb011d079c8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:59.506753 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b695585b-4b54-49aa-a18e-cbb011d079c8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:59.507192 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b695585b-4b54-49aa-a18e-cbb011d079c8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:59.507875 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b695585b-4b54-49aa-a18e-cbb011d079c8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:54:59.508326 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b695585b-4b54-49aa-a18e-cbb011d079c8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:54:59.508746 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b695585b-4b54-49aa-a18e-cbb011d079c8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:54:59.634977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-b695585b-4b54-49aa-a18e-cbb011d079c8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:54:59.642793 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-b695585b-4b54-49aa-a18e-cbb011d079c8 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8" status: 200 len: 1366 microversion: 2.1 time: 0.147855 Aug 12 11:54:59.643355 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 359/724] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:54:59 2022] GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:55:00.664314 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-9566e3fc-87a2-4b9c-8358-6c25f696c583 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:00.665004 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-9566e3fc-87a2-4b9c-8358-6c25f696c583 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:00.671626 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9566e3fc-87a2-4b9c-8358-6c25f696c583 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:00.672104 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9566e3fc-87a2-4b9c-8358-6c25f696c583 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:00.672534 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9566e3fc-87a2-4b9c-8358-6c25f696c583 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:00.673217 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9566e3fc-87a2-4b9c-8358-6c25f696c583 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:00.673665 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9566e3fc-87a2-4b9c-8358-6c25f696c583 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:00.674086 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9566e3fc-87a2-4b9c-8358-6c25f696c583 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:00.800984 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-9566e3fc-87a2-4b9c-8358-6c25f696c583 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:00.808424 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-9566e3fc-87a2-4b9c-8358-6c25f696c583 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8" status: 200 len: 1366 microversion: 2.1 time: 0.148819 Aug 12 11:55:00.808989 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 366/725] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:55:00 2022] GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:55:01.830068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-9922ed7d-7da1-4a14-9964-eb15d1b60473 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:01.830699 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-9922ed7d-7da1-4a14-9964-eb15d1b60473 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:01.837036 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9922ed7d-7da1-4a14-9964-eb15d1b60473 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:01.837512 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9922ed7d-7da1-4a14-9964-eb15d1b60473 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:01.837944 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9922ed7d-7da1-4a14-9964-eb15d1b60473 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:01.838644 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9922ed7d-7da1-4a14-9964-eb15d1b60473 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:01.839100 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9922ed7d-7da1-4a14-9964-eb15d1b60473 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:01.839521 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9922ed7d-7da1-4a14-9964-eb15d1b60473 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:01.965978 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-9922ed7d-7da1-4a14-9964-eb15d1b60473 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:01.973230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-9922ed7d-7da1-4a14-9964-eb15d1b60473 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8" status: 200 len: 1366 microversion: 2.1 time: 0.147640 Aug 12 11:55:01.973785 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 360/726] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:55:01 2022] GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:55:02.993785 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-6269924f-fdf5-4116-ad5e-1fad1ce949ff tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:02.994392 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-6269924f-fdf5-4116-ad5e-1fad1ce949ff tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:03.000744 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6269924f-fdf5-4116-ad5e-1fad1ce949ff tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:03.001220 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6269924f-fdf5-4116-ad5e-1fad1ce949ff tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:03.001656 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6269924f-fdf5-4116-ad5e-1fad1ce949ff tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:03.002337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6269924f-fdf5-4116-ad5e-1fad1ce949ff tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:03.002815 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6269924f-fdf5-4116-ad5e-1fad1ce949ff tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:03.003236 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6269924f-fdf5-4116-ad5e-1fad1ce949ff tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:03.132569 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-6269924f-fdf5-4116-ad5e-1fad1ce949ff tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:03.141716 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-6269924f-fdf5-4116-ad5e-1fad1ce949ff tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8" status: 200 len: 1366 microversion: 2.1 time: 0.151738 Aug 12 11:55:03.142275 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 367/727] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:55:02 2022] GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:55:03.199364 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-3fb10516-a5b8-4efd-86a1-53db9ef45ef9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:03.199856 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-3fb10516-a5b8-4efd-86a1-53db9ef45ef9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:03.206189 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3fb10516-a5b8-4efd-86a1-53db9ef45ef9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:03.206703 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3fb10516-a5b8-4efd-86a1-53db9ef45ef9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:03.207143 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3fb10516-a5b8-4efd-86a1-53db9ef45ef9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:03.207825 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3fb10516-a5b8-4efd-86a1-53db9ef45ef9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:03.208279 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3fb10516-a5b8-4efd-86a1-53db9ef45ef9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:03.208720 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3fb10516-a5b8-4efd-86a1-53db9ef45ef9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:03.286462 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.objects.instance [None req-3fb10516-a5b8-4efd-86a1-53db9ef45ef9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lazy-loading 'services' on Instance uuid 7545dc36-2c18-434c-94e4-771977a58319 {{(pid=132282) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:55:03.396383 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-3fb10516-a5b8-4efd-86a1-53db9ef45ef9 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319/os-volume_attachments/fde48ed1-a110-4ae9-a30b-fc5f73625c30" status: 202 len: 0 microversion: 2.1 time: 0.200308 Aug 12 11:55:03.396983 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 361/728] 10.222.0.42 () {58 vars in 1416 bytes} [Fri Aug 12 11:55:03 2022] DELETE /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319/os-volume_attachments/fde48ed1-a110-4ae9-a30b-fc5f73625c30 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:55:03.407008 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-f1ed4d71-3e52-4f36-b5e2-ede1a84230ea tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:03.409260 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-f1ed4d71-3e52-4f36-b5e2-ede1a84230ea tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:03.416175 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f1ed4d71-3e52-4f36-b5e2-ede1a84230ea tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:03.416662 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f1ed4d71-3e52-4f36-b5e2-ede1a84230ea tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:03.417130 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f1ed4d71-3e52-4f36-b5e2-ede1a84230ea tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:03.417863 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f1ed4d71-3e52-4f36-b5e2-ede1a84230ea tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:03.418312 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f1ed4d71-3e52-4f36-b5e2-ede1a84230ea tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:03.418771 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f1ed4d71-3e52-4f36-b5e2-ede1a84230ea tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:03.451585 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-f1ed4d71-3e52-4f36-b5e2-ede1a84230ea tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049380 Aug 12 11:55:03.452029 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 368/729] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Aug 12 11:55:03 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:55:04.163485 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-3898fa38-c4aa-4859-a079-fa4bb8be7ea9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:04.164199 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-3898fa38-c4aa-4859-a079-fa4bb8be7ea9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:04.171055 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3898fa38-c4aa-4859-a079-fa4bb8be7ea9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:04.171530 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3898fa38-c4aa-4859-a079-fa4bb8be7ea9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:04.171956 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3898fa38-c4aa-4859-a079-fa4bb8be7ea9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:04.172632 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3898fa38-c4aa-4859-a079-fa4bb8be7ea9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:04.173082 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3898fa38-c4aa-4859-a079-fa4bb8be7ea9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:04.173499 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3898fa38-c4aa-4859-a079-fa4bb8be7ea9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:04.301225 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-3898fa38-c4aa-4859-a079-fa4bb8be7ea9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:04.309081 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-3898fa38-c4aa-4859-a079-fa4bb8be7ea9 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8" status: 200 len: 1366 microversion: 2.1 time: 0.149750 Aug 12 11:55:04.309648 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 362/730] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:55:04 2022] GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:55:04.417894 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-59040365-841e-45b6-ac1a-2b7eb17391a8 req-3f7a40f3-7f0a-46bf-8866-a6ee898d4ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15bed11d-dd0b-4cc8-ab40-968fdf8689c8", "name": "network-vif-plugged", "status": "completed", "tag": "74085585-4c60-4395-8719-be2205ab20cc"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:55:04.431167 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-59040365-841e-45b6-ac1a-2b7eb17391a8 req-3f7a40f3-7f0a-46bf-8866-a6ee898d4ff0 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:04.433273 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-59040365-841e-45b6-ac1a-2b7eb17391a8 req-3f7a40f3-7f0a-46bf-8866-a6ee898d4ff0 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:04.433273 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-59040365-841e-45b6-ac1a-2b7eb17391a8 req-3f7a40f3-7f0a-46bf-8866-a6ee898d4ff0 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:04.446365 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-59040365-841e-45b6-ac1a-2b7eb17391a8 req-3f7a40f3-7f0a-46bf-8866-a6ee898d4ff0 service nova] Creating event network-vif-plugged:74085585-4c60-4395-8719-be2205ab20cc for instance 15bed11d-dd0b-4cc8-ab40-968fdf8689c8 on hv-cinder-85282 Aug 12 11:55:04.452183 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-59040365-841e-45b6-ac1a-2b7eb17391a8 req-3f7a40f3-7f0a-46bf-8866-a6ee898d4ff0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038939 Aug 12 11:55:04.453439 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 369/731] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:55:04.464465 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-545ab17b-c183-4e28-83ca-cb1c7a1cec38 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:04.467524 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-545ab17b-c183-4e28-83ca-cb1c7a1cec38 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:04.473638 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-545ab17b-c183-4e28-83ca-cb1c7a1cec38 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:04.474128 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-545ab17b-c183-4e28-83ca-cb1c7a1cec38 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:04.474570 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-545ab17b-c183-4e28-83ca-cb1c7a1cec38 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:04.475296 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-545ab17b-c183-4e28-83ca-cb1c7a1cec38 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:04.475751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-545ab17b-c183-4e28-83ca-cb1c7a1cec38 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:04.476177 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-545ab17b-c183-4e28-83ca-cb1c7a1cec38 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:04.505094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-545ab17b-c183-4e28-83ca-cb1c7a1cec38 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044884 Aug 12 11:55:04.505659 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 363/732] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Aug 12 11:55:04 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 12 11:55:04.579517 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-9e3a5fed-7ad0-4ae0-b183-4e1480b39b59 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:04.580105 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-9e3a5fed-7ad0-4ae0-b183-4e1480b39b59 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:04.586479 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9e3a5fed-7ad0-4ae0-b183-4e1480b39b59 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:04.587004 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9e3a5fed-7ad0-4ae0-b183-4e1480b39b59 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:04.587446 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9e3a5fed-7ad0-4ae0-b183-4e1480b39b59 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:04.588211 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9e3a5fed-7ad0-4ae0-b183-4e1480b39b59 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:04.588664 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9e3a5fed-7ad0-4ae0-b183-4e1480b39b59 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:04.589354 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9e3a5fed-7ad0-4ae0-b183-4e1480b39b59 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:04.617432 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-9e3a5fed-7ad0-4ae0-b183-4e1480b39b59 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Going to try to terminate instance {{(pid=132281) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 11:55:04.697058 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-9e3a5fed-7ad0-4ae0-b183-4e1480b39b59 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 204 len: 0 microversion: 2.1 time: 0.121690 Aug 12 11:55:04.698234 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 370/733] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Aug 12 11:55:04 2022] DELETE /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 11:55:04.707248 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-793096b1-1366-498b-a678-85e67a186874 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:04.707871 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-793096b1-1366-498b-a678-85e67a186874 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:04.713989 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-793096b1-1366-498b-a678-85e67a186874 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:04.714462 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-793096b1-1366-498b-a678-85e67a186874 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:04.714963 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-793096b1-1366-498b-a678-85e67a186874 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:04.715653 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-793096b1-1366-498b-a678-85e67a186874 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:04.716664 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-793096b1-1366-498b-a678-85e67a186874 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:04.717111 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-793096b1-1366-498b-a678-85e67a186874 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:04.844233 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-793096b1-1366-498b-a678-85e67a186874 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:04.851685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-793096b1-1366-498b-a678-85e67a186874 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1689 microversion: 2.1 time: 0.148227 Aug 12 11:55:04.852245 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 364/734] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:55:04 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:55:05.330029 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-08ca506a-aa52-40ad-9769-90d37e936aa6 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:05.330756 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-08ca506a-aa52-40ad-9769-90d37e936aa6 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:05.336575 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-08ca506a-aa52-40ad-9769-90d37e936aa6 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:05.337045 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-08ca506a-aa52-40ad-9769-90d37e936aa6 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:05.337471 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-08ca506a-aa52-40ad-9769-90d37e936aa6 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:05.338330 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-08ca506a-aa52-40ad-9769-90d37e936aa6 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:05.338810 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-08ca506a-aa52-40ad-9769-90d37e936aa6 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:05.339226 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-08ca506a-aa52-40ad-9769-90d37e936aa6 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:05.477895 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-08ca506a-aa52-40ad-9769-90d37e936aa6 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:05.485860 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-08ca506a-aa52-40ad-9769-90d37e936aa6 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8" status: 200 len: 1366 microversion: 2.1 time: 0.160069 Aug 12 11:55:05.486442 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 371/735] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:55:05 2022] GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:55:05.871970 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-87686111-c361-4d09-bd1f-2a60782c5565 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:05.873062 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-87686111-c361-4d09-bd1f-2a60782c5565 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:05.879448 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-87686111-c361-4d09-bd1f-2a60782c5565 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:05.879929 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-87686111-c361-4d09-bd1f-2a60782c5565 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:05.880361 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-87686111-c361-4d09-bd1f-2a60782c5565 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:05.881037 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-87686111-c361-4d09-bd1f-2a60782c5565 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:05.881489 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-87686111-c361-4d09-bd1f-2a60782c5565 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:05.881909 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-87686111-c361-4d09-bd1f-2a60782c5565 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:06.009235 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-87686111-c361-4d09-bd1f-2a60782c5565 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:06.017469 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-87686111-c361-4d09-bd1f-2a60782c5565 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1689 microversion: 2.1 time: 0.149363 Aug 12 11:55:06.018036 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 365/736] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:55:05 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:55:06.507023 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-4ad68a83-2623-495d-b1e3-ab5121f5c0b2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:06.507548 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-4ad68a83-2623-495d-b1e3-ab5121f5c0b2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:06.509472 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell0:SELECT=2 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:06.510116 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell0:SELECT=6 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:06.516993 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4ad68a83-2623-495d-b1e3-ab5121f5c0b2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:06.517473 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4ad68a83-2623-495d-b1e3-ab5121f5c0b2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:06.517907 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4ad68a83-2623-495d-b1e3-ab5121f5c0b2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:06.518748 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4ad68a83-2623-495d-b1e3-ab5121f5c0b2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:06.519204 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4ad68a83-2623-495d-b1e3-ab5121f5c0b2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:06.519626 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4ad68a83-2623-495d-b1e3-ab5121f5c0b2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:06.644712 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-4ad68a83-2623-495d-b1e3-ab5121f5c0b2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:06.652023 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-4ad68a83-2623-495d-b1e3-ab5121f5c0b2 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8" status: 200 len: 1366 microversion: 2.1 time: 0.148885 Aug 12 11:55:06.652582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 372/737] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:55:06 2022] GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:55:07.038345 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-85e37bf8-7ed5-4bde-b379-f05ac87214f5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:07.038983 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-85e37bf8-7ed5-4bde-b379-f05ac87214f5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:07.040894 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=6 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:07.047021 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-85e37bf8-7ed5-4bde-b379-f05ac87214f5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:07.047504 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-85e37bf8-7ed5-4bde-b379-f05ac87214f5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:07.047935 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-85e37bf8-7ed5-4bde-b379-f05ac87214f5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:07.048674 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-85e37bf8-7ed5-4bde-b379-f05ac87214f5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:07.049105 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-85e37bf8-7ed5-4bde-b379-f05ac87214f5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:07.049526 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-85e37bf8-7ed5-4bde-b379-f05ac87214f5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:07.176915 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-85e37bf8-7ed5-4bde-b379-f05ac87214f5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:07.184220 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-85e37bf8-7ed5-4bde-b379-f05ac87214f5 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1689 microversion: 2.1 time: 0.149713 Aug 12 11:55:07.185558 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 366/738] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:55:07 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:55:07.673270 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e54e3c0f-0fa9-4e66-92b1-a8a0b6d4f979 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:07.673933 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-e54e3c0f-0fa9-4e66-92b1-a8a0b6d4f979 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:07.680289 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e54e3c0f-0fa9-4e66-92b1-a8a0b6d4f979 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:07.680768 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e54e3c0f-0fa9-4e66-92b1-a8a0b6d4f979 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:07.681200 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e54e3c0f-0fa9-4e66-92b1-a8a0b6d4f979 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:07.681879 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e54e3c0f-0fa9-4e66-92b1-a8a0b6d4f979 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:07.682325 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e54e3c0f-0fa9-4e66-92b1-a8a0b6d4f979 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:07.682778 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e54e3c0f-0fa9-4e66-92b1-a8a0b6d4f979 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:07.807521 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-e54e3c0f-0fa9-4e66-92b1-a8a0b6d4f979 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:07.815080 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-e54e3c0f-0fa9-4e66-92b1-a8a0b6d4f979 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8" status: 200 len: 1366 microversion: 2.1 time: 0.146083 Aug 12 11:55:07.815647 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 373/739] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:55:07 2022] GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:55:08.206106 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-6f8e0fbb-6a5f-4668-970a-340b2b349f7d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:08.206738 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-6f8e0fbb-6a5f-4668-970a-340b2b349f7d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:08.213170 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6f8e0fbb-6a5f-4668-970a-340b2b349f7d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:08.213642 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6f8e0fbb-6a5f-4668-970a-340b2b349f7d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:08.214072 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6f8e0fbb-6a5f-4668-970a-340b2b349f7d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:08.214783 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6f8e0fbb-6a5f-4668-970a-340b2b349f7d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:08.215230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6f8e0fbb-6a5f-4668-970a-340b2b349f7d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:08.215647 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6f8e0fbb-6a5f-4668-970a-340b2b349f7d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:08.344465 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-6f8e0fbb-6a5f-4668-970a-340b2b349f7d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:08.351816 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-6f8e0fbb-6a5f-4668-970a-340b2b349f7d tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1689 microversion: 2.1 time: 0.149488 Aug 12 11:55:08.352403 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 367/740] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:55:08 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:55:08.835289 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-a902ff0a-26ae-4fd3-a779-51f8e5c509b4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:08.835891 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-a902ff0a-26ae-4fd3-a779-51f8e5c509b4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:08.842686 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a902ff0a-26ae-4fd3-a779-51f8e5c509b4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:08.843166 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a902ff0a-26ae-4fd3-a779-51f8e5c509b4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:08.843596 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a902ff0a-26ae-4fd3-a779-51f8e5c509b4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:08.844279 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a902ff0a-26ae-4fd3-a779-51f8e5c509b4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:08.844727 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a902ff0a-26ae-4fd3-a779-51f8e5c509b4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:08.845145 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a902ff0a-26ae-4fd3-a779-51f8e5c509b4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:08.976846 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-a902ff0a-26ae-4fd3-a779-51f8e5c509b4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:08.984798 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-a902ff0a-26ae-4fd3-a779-51f8e5c509b4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8" status: 200 len: 1366 microversion: 2.1 time: 0.153417 Aug 12 11:55:08.985359 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 374/741] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:55:08 2022] GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:55:09.373340 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-2367475b-67f4-4150-ad31-c64d48bffcc1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:09.373954 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-2367475b-67f4-4150-ad31-c64d48bffcc1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:09.380558 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2367475b-67f4-4150-ad31-c64d48bffcc1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:09.381179 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2367475b-67f4-4150-ad31-c64d48bffcc1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:09.381535 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2367475b-67f4-4150-ad31-c64d48bffcc1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:09.382242 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2367475b-67f4-4150-ad31-c64d48bffcc1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:09.382728 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2367475b-67f4-4150-ad31-c64d48bffcc1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:09.383153 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2367475b-67f4-4150-ad31-c64d48bffcc1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:09.575321 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-2367475b-67f4-4150-ad31-c64d48bffcc1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:09.583311 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-2367475b-67f4-4150-ad31-c64d48bffcc1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 200 len: 1689 microversion: 2.1 time: 0.214454 Aug 12 11:55:09.584036 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 368/742] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:55:09 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 1689 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:55:09.918724 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-05347b57-8b6c-4ee1-a958-0886260e7212 req-dc7eab24-8d07-4c08-bb92-0b17da703e6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7545dc36-2c18-434c-94e4-771977a58319", "name": "network-vif-deleted", "tag": "b5a1de41-5667-4746-80f9-9707f4939d87"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:55:09.928713 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-05347b57-8b6c-4ee1-a958-0886260e7212 req-dc7eab24-8d07-4c08-bb92-0b17da703e6c service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:09.929188 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-05347b57-8b6c-4ee1-a958-0886260e7212 req-dc7eab24-8d07-4c08-bb92-0b17da703e6c service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:09.929614 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-05347b57-8b6c-4ee1-a958-0886260e7212 req-dc7eab24-8d07-4c08-bb92-0b17da703e6c service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:09.941556 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-05347b57-8b6c-4ee1-a958-0886260e7212 req-dc7eab24-8d07-4c08-bb92-0b17da703e6c service nova] Creating event network-vif-deleted:b5a1de41-5667-4746-80f9-9707f4939d87 for instance 7545dc36-2c18-434c-94e4-771977a58319 on hv-cinder-85282 Aug 12 11:55:09.946197 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-05347b57-8b6c-4ee1-a958-0886260e7212 req-dc7eab24-8d07-4c08-bb92-0b17da703e6c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031250 Aug 12 11:55:09.949739 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 375/743] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:55:10.005440 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-4654cd58-d92a-4c29-86be-1084a3751f38 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:10.006078 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-4654cd58-d92a-4c29-86be-1084a3751f38 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:10.013774 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4654cd58-d92a-4c29-86be-1084a3751f38 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:10.014263 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4654cd58-d92a-4c29-86be-1084a3751f38 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:10.014753 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4654cd58-d92a-4c29-86be-1084a3751f38 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:10.015426 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4654cd58-d92a-4c29-86be-1084a3751f38 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:10.015882 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4654cd58-d92a-4c29-86be-1084a3751f38 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:10.016305 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4654cd58-d92a-4c29-86be-1084a3751f38 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:10.192162 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-4654cd58-d92a-4c29-86be-1084a3751f38 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:10.206193 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-4654cd58-d92a-4c29-86be-1084a3751f38 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8" status: 200 len: 1557 microversion: 2.1 time: 0.204560 Aug 12 11:55:10.206813 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 369/744] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:55:10 2022] GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8 => generated 1557 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:55:10.227028 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-1a5f9f61-b638-4d12-bde0-b692c477a389 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:10.227631 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-1a5f9f61-b638-4d12-bde0-b692c477a389 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:10.233700 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1a5f9f61-b638-4d12-bde0-b692c477a389 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:10.234171 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1a5f9f61-b638-4d12-bde0-b692c477a389 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:10.234598 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1a5f9f61-b638-4d12-bde0-b692c477a389 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:10.235303 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1a5f9f61-b638-4d12-bde0-b692c477a389 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:10.235748 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1a5f9f61-b638-4d12-bde0-b692c477a389 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:10.236191 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1a5f9f61-b638-4d12-bde0-b692c477a389 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:10.313809 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-1a5f9f61-b638-4d12-bde0-b692c477a389 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091045 Aug 12 11:55:10.314508 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 376/745] 10.222.0.42 () {58 vars in 1275 bytes} [Fri Aug 12 11:55:10 2022] GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:55:10.605981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-3fb87087-74fb-4284-ac8d-495af66ebc0e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:10.606937 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-3fb87087-74fb-4284-ac8d-495af66ebc0e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 7545dc36-2c18-434c-94e4-771977a58319] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:10.615156 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3fb87087-74fb-4284-ac8d-495af66ebc0e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:10.615755 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3fb87087-74fb-4284-ac8d-495af66ebc0e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:10.616272 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3fb87087-74fb-4284-ac8d-495af66ebc0e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:10.617326 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3fb87087-74fb-4284-ac8d-495af66ebc0e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:10.618087 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3fb87087-74fb-4284-ac8d-495af66ebc0e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:10.618883 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3fb87087-74fb-4284-ac8d-495af66ebc0e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:10.634157 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.wsgi [None req-3fb87087-74fb-4284-ac8d-495af66ebc0e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] HTTP exception thrown: Instance 7545dc36-2c18-434c-94e4-771977a58319 could not be found. Aug 12 11:55:10.636751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-3fb87087-74fb-4284-ac8d-495af66ebc0e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Request method failure captured: Aug 12 11:55:10.636751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 HTTP/1.1 Aug 12 11:55:10.636751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 11:55:10.636751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 11:55:10.636751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 11:55:10.636751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 0 Aug 12 11:55:10.636751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 11:55:10.636751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 11:55:10.636751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 11:55:10.636751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 11:55:10.636751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9j5mt6PNioe5iUGgp3CAkbSyYo_AhdYrVYhlzDi6Qs9O2Aks8er4C3JcoLHmjMk4ocUEKhdotNj2qgtAdK9WiQzA1AjEiu4Ps5qMdbbFZI3icMtnprp3XMTKgh0QwzwvvdyNK5uaTpRPPinF6P3wPdnin1wNbpohTf1mbuSCDgZlVZU Aug 12 11:55:10.636751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 11:55:10.636751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 11:55:10.636751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 11:55:10.636751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 11:55:10.636751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 11:55:10.636751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 11:55:10.636751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: a7e2fce9e9db463aa70188453f20d110 Aug 12 11:55:10.636751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-758473035 Aug 12 11:55:10.636751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 11:55:10.636751 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 11:55:10.638754 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a7e2fce9e9db463aa70188453f20d110", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a7e2fce9e9db463aa70188453f20d110"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7e2fce9e9db463aa70188453f20d110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7e2fce9e9db463aa70188453f20d110"}]}] Aug 12 11:55:10.638754 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-ServerRescueNegativeTestJSON-758473035 Aug 12 11:55:10.638754 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: a7e2fce9e9db463aa70188453f20d110 Aug 12 11:55:10.638754 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-758473035 Aug 12 11:55:10.638754 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-ServerRescueNegativeTestJSON-758473035-project Aug 12 11:55:10.638754 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 11:55:10.638754 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 11:55:10.638754 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: 64ec7445644e478ca961be80f84f9863 Aug 12 11:55:10.638754 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-ServerRescueNegativeTestJSON-758473035-project Aug 12 11:55:10.638754 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: > Aug 12 11:55:10.638754 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Instance 7545dc36-2c18-434c-94e4-771977a58319 could not be found. Aug 12 11:55:10.638754 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'id': '7545dc36-2c18-434c-94e4-771977a58319'} Aug 12 11:55:10.639519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:55:10.639519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:10.639519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:55:10.639519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:55:10.639519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:55:10.639519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:55:10.639519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:55:10.639519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:55:10.639519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:55:10.639519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:55:10.639519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7545dc36-2c18-434c-94e4-771977a58319 could not be found. Aug 12 11:55:10.639519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:10.639519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:55:10.639519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:10.639519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:10.639519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:55:10.639519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:55:10.639519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:55:10.639519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:55:10.639519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:55:10.640865 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:55:10.640865 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:55:10.640865 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:55:10.640865 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:55:10.640865 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:55:10.640865 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:55:10.640865 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:55:10.640865 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7545dc36-2c18-434c-94e4-771977a58319 could not be found. Aug 12 11:55:10.640865 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:10.640865 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:55:10.640865 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:10.640865 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:10.640865 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:55:10.640865 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:55:10.640865 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:55:10.640865 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:55:10.640865 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7545dc36-2c18-434c-94e4-771977a58319 could not be found. Aug 12 11:55:10.640865 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:10.642021 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-3fb87087-74fb-4284-ac8d-495af66ebc0e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Returning 404 to user: Instance 7545dc36-2c18-434c-94e4-771977a58319 could not be found. {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:55:10.642021 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-3fb87087-74fb-4284-ac8d-495af66ebc0e tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319" status: 404 len: 111 microversion: 2.1 time: 0.037203 Aug 12 11:55:10.642021 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 370/746] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:55:10 2022] GET /compute/v2.1/servers/7545dc36-2c18-434c-94e4-771977a58319 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:55:10.650773 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-5c56fa19-aae2-45de-bf56-caabdf958f87 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '.version_select at 0x7f3e4bfc30d0>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:10.673359 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-5c56fa19-aae2-45de-bf56-caabdf958f87 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1657146943" status: 202 len: 0 microversion: 2.1 time: 0.026362 Aug 12 11:55:10.674256 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 377/747] 10.222.0.42 () {58 vars in 1221 bytes} [Fri Aug 12 11:55:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1657146943 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:55:11.655522 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-5370eacf-a70d-48f0-959f-bfb94e42cfe9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:11.656035 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-5370eacf-a70d-48f0-959f-bfb94e42cfe9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:11.662314 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5370eacf-a70d-48f0-959f-bfb94e42cfe9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:11.663080 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5370eacf-a70d-48f0-959f-bfb94e42cfe9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:11.663522 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5370eacf-a70d-48f0-959f-bfb94e42cfe9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:11.664223 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5370eacf-a70d-48f0-959f-bfb94e42cfe9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:11.664887 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5370eacf-a70d-48f0-959f-bfb94e42cfe9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:11.665479 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5370eacf-a70d-48f0-959f-bfb94e42cfe9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:11.681719 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:11.692676 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-5370eacf-a70d-48f0-959f-bfb94e42cfe9 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834/ips" status: 200 len: 153 microversion: 2.20 time: 0.284622 Aug 12 11:55:11.693232 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 371/748] 10.222.0.42 () {60 vars in 1289 bytes} [Fri Aug 12 11:55:11 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834/ips => generated 153 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 11:55:11.964743 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-913359e1-f8ef-4485-b7a7-f464e0794ef8 req-24d4e340-95e8-4aef-b095-c1dd94f5ed0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15bed11d-dd0b-4cc8-ab40-968fdf8689c8", "tag": "74085585-4c60-4395-8719-be2205ab20cc"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:55:11.988260 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-913359e1-f8ef-4485-b7a7-f464e0794ef8 req-24d4e340-95e8-4aef-b095-c1dd94f5ed0a service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:11.988847 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-913359e1-f8ef-4485-b7a7-f464e0794ef8 req-24d4e340-95e8-4aef-b095-c1dd94f5ed0a service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:11.989368 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-913359e1-f8ef-4485-b7a7-f464e0794ef8 req-24d4e340-95e8-4aef-b095-c1dd94f5ed0a service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:12.000327 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-913359e1-f8ef-4485-b7a7-f464e0794ef8 req-24d4e340-95e8-4aef-b095-c1dd94f5ed0a service nova] Creating event network-changed:74085585-4c60-4395-8719-be2205ab20cc for instance 15bed11d-dd0b-4cc8-ab40-968fdf8689c8 on hv-cinder-85282 Aug 12 11:55:12.006545 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-913359e1-f8ef-4485-b7a7-f464e0794ef8 req-24d4e340-95e8-4aef-b095-c1dd94f5ed0a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046737 Aug 12 11:55:12.007319 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 378/749] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:55:13.485739 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-04494400-524d-413b-93d3-a5788b866197 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:55:13.486305 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-04494400-524d-413b-93d3-a5788b866197 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:13.493154 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-04494400-524d-413b-93d3-a5788b866197 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:13.493627 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-04494400-524d-413b-93d3-a5788b866197 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:13.494058 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-04494400-524d-413b-93d3-a5788b866197 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:13.494761 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-04494400-524d-413b-93d3-a5788b866197 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:13.495206 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-04494400-524d-413b-93d3-a5788b866197 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:13.495622 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-04494400-524d-413b-93d3-a5788b866197 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:13.517778 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.objects.instance [None req-04494400-524d-413b-93d3-a5788b866197 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lazy-loading 'flavor' on Instance uuid 766f6d20-8985-4a72-b2d7-4062c001c834 {{(pid=132282) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:55:13.723161 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-04494400-524d-413b-93d3-a5788b866197 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "POST /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834/action" status: 202 len: 0 microversion: 2.20 time: 0.241160 Aug 12 11:55:13.723745 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 372/750] 10.222.0.42 () {62 vars in 1319 bytes} [Fri Aug 12 11:55:13 2022] POST /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 12 11:55:13.732981 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-bf8ff4ca-5e1d-4701-b955-cb5202f71eeb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:13.733670 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-bf8ff4ca-5e1d-4701-b955-cb5202f71eeb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:13.739696 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bf8ff4ca-5e1d-4701-b955-cb5202f71eeb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:13.740151 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bf8ff4ca-5e1d-4701-b955-cb5202f71eeb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:13.740583 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bf8ff4ca-5e1d-4701-b955-cb5202f71eeb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:13.741296 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bf8ff4ca-5e1d-4701-b955-cb5202f71eeb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:13.741702 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bf8ff4ca-5e1d-4701-b955-cb5202f71eeb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:13.742114 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bf8ff4ca-5e1d-4701-b955-cb5202f71eeb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:13.746334 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:13.814778 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-7739dde3-4c57-42af-bc99-7759f01a0c6f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:13.815436 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-7739dde3-4c57-42af-bc99-7759f01a0c6f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:13.822553 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7739dde3-4c57-42af-bc99-7759f01a0c6f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:13.823164 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7739dde3-4c57-42af-bc99-7759f01a0c6f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:13.823672 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7739dde3-4c57-42af-bc99-7759f01a0c6f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:13.824434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7739dde3-4c57-42af-bc99-7759f01a0c6f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:13.824976 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7739dde3-4c57-42af-bc99-7759f01a0c6f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:13.826005 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7739dde3-4c57-42af-bc99-7759f01a0c6f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:13.850936 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-7739dde3-4c57-42af-bc99-7759f01a0c6f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Going to try to terminate instance {{(pid=132282) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 11:55:13.881547 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-bf8ff4ca-5e1d-4701-b955-cb5202f71eeb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:13.889502 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-bf8ff4ca-5e1d-4701-b955-cb5202f71eeb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:13.891111 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-bf8ff4ca-5e1d-4701-b955-cb5202f71eeb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:13.892337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-bf8ff4ca-5e1d-4701-b955-cb5202f71eeb tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1724 microversion: 2.20 time: 0.164107 Aug 12 11:55:13.892964 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 379/751] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:13 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:13.928762 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-7739dde3-4c57-42af-bc99-7759f01a0c6f tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 204 len: 0 microversion: 2.1 time: 0.118301 Aug 12 11:55:13.929479 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 373/752] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Aug 12 11:55:13 2022] DELETE /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 12 11:55:13.937886 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-2d2eb3e2-bddc-4307-b203-fa75e5cb8a35 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:13.938488 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-2d2eb3e2-bddc-4307-b203-fa75e5cb8a35 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:13.944605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2d2eb3e2-bddc-4307-b203-fa75e5cb8a35 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:13.945085 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2d2eb3e2-bddc-4307-b203-fa75e5cb8a35 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:13.945525 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2d2eb3e2-bddc-4307-b203-fa75e5cb8a35 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:13.946203 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2d2eb3e2-bddc-4307-b203-fa75e5cb8a35 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:13.946683 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2d2eb3e2-bddc-4307-b203-fa75e5cb8a35 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:13.947101 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2d2eb3e2-bddc-4307-b203-fa75e5cb8a35 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:14.071913 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-2d2eb3e2-bddc-4307-b203-fa75e5cb8a35 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:14.079528 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-2d2eb3e2-bddc-4307-b203-fa75e5cb8a35 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1507 microversion: 2.1 time: 0.145822 Aug 12 11:55:14.080098 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 380/753] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:55:13 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1507 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:55:14.917020 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-feca6451-7928-4747-9438-cf180cae2ee3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:14.917665 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-feca6451-7928-4747-9438-cf180cae2ee3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:14.924513 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-feca6451-7928-4747-9438-cf180cae2ee3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:14.924996 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-feca6451-7928-4747-9438-cf180cae2ee3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:14.925434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-feca6451-7928-4747-9438-cf180cae2ee3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:14.926120 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-feca6451-7928-4747-9438-cf180cae2ee3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:14.926580 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-feca6451-7928-4747-9438-cf180cae2ee3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:14.927024 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-feca6451-7928-4747-9438-cf180cae2ee3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:15.055941 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-feca6451-7928-4747-9438-cf180cae2ee3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:15.064703 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-feca6451-7928-4747-9438-cf180cae2ee3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:15.066199 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-feca6451-7928-4747-9438-cf180cae2ee3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:15.068401 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-feca6451-7928-4747-9438-cf180cae2ee3 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1724 microversion: 2.20 time: 0.155648 Aug 12 11:55:15.068401 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 374/754] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:14 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:15.101265 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-4df0aeb3-72d2-4058-9fe5-87ad58d753ba tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:15.101869 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-4df0aeb3-72d2-4058-9fe5-87ad58d753ba tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:15.104276 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:15.110270 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4df0aeb3-72d2-4058-9fe5-87ad58d753ba tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:15.110784 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4df0aeb3-72d2-4058-9fe5-87ad58d753ba tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:15.111217 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4df0aeb3-72d2-4058-9fe5-87ad58d753ba tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:15.112020 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4df0aeb3-72d2-4058-9fe5-87ad58d753ba tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:15.112475 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4df0aeb3-72d2-4058-9fe5-87ad58d753ba tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:15.112900 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4df0aeb3-72d2-4058-9fe5-87ad58d753ba tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:15.240237 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-4df0aeb3-72d2-4058-9fe5-87ad58d753ba tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:15.248254 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-4df0aeb3-72d2-4058-9fe5-87ad58d753ba tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1507 microversion: 2.1 time: 0.150912 Aug 12 11:55:15.248813 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 381/755] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:55:15 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:55:16.089379 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-f3d61207-dfe2-4e5b-a504-e9946facf1c6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:16.090010 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-f3d61207-dfe2-4e5b-a504-e9946facf1c6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:16.097469 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f3d61207-dfe2-4e5b-a504-e9946facf1c6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:16.097945 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f3d61207-dfe2-4e5b-a504-e9946facf1c6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:16.098372 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f3d61207-dfe2-4e5b-a504-e9946facf1c6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:16.099116 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f3d61207-dfe2-4e5b-a504-e9946facf1c6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:16.099560 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f3d61207-dfe2-4e5b-a504-e9946facf1c6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:16.099979 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f3d61207-dfe2-4e5b-a504-e9946facf1c6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:16.232137 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-f3d61207-dfe2-4e5b-a504-e9946facf1c6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:16.239840 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-f3d61207-dfe2-4e5b-a504-e9946facf1c6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:16.241352 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-f3d61207-dfe2-4e5b-a504-e9946facf1c6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:16.242482 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-f3d61207-dfe2-4e5b-a504-e9946facf1c6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1724 microversion: 2.20 time: 0.157037 Aug 12 11:55:16.243050 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 375/756] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:16 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:16.268945 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-0252277d-ef93-4af3-bac6-7f389deae5a2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:16.269618 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-0252277d-ef93-4af3-bac6-7f389deae5a2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:16.275949 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0252277d-ef93-4af3-bac6-7f389deae5a2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:16.276423 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0252277d-ef93-4af3-bac6-7f389deae5a2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:16.276850 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0252277d-ef93-4af3-bac6-7f389deae5a2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:16.277523 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0252277d-ef93-4af3-bac6-7f389deae5a2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:16.277975 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0252277d-ef93-4af3-bac6-7f389deae5a2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:16.278914 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0252277d-ef93-4af3-bac6-7f389deae5a2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:16.404068 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-0252277d-ef93-4af3-bac6-7f389deae5a2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:16.411440 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-0252277d-ef93-4af3-bac6-7f389deae5a2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1507 microversion: 2.1 time: 0.146302 Aug 12 11:55:16.411998 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 382/757] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:55:16 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1507 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:55:16.953864 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-348cd57a-9d8e-4ea5-b3f6-e4812ed30382 req-24de4fab-5217-4c28-b1e0-16da199b926e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e56c585-652b-4059-b3f6-280d542ee20f", "name": "network-vif-deleted", "tag": "22832d7b-ac7a-4e86-862c-68b38289d769"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:55:16.963560 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-348cd57a-9d8e-4ea5-b3f6-e4812ed30382 req-24de4fab-5217-4c28-b1e0-16da199b926e service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:16.964046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-348cd57a-9d8e-4ea5-b3f6-e4812ed30382 req-24de4fab-5217-4c28-b1e0-16da199b926e service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:16.964477 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-348cd57a-9d8e-4ea5-b3f6-e4812ed30382 req-24de4fab-5217-4c28-b1e0-16da199b926e service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:16.975356 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-348cd57a-9d8e-4ea5-b3f6-e4812ed30382 req-24de4fab-5217-4c28-b1e0-16da199b926e service nova] Creating event network-vif-deleted:22832d7b-ac7a-4e86-862c-68b38289d769 for instance 5e56c585-652b-4059-b3f6-280d542ee20f on hv-cinder-85282 Aug 12 11:55:16.980249 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-348cd57a-9d8e-4ea5-b3f6-e4812ed30382 req-24de4fab-5217-4c28-b1e0-16da199b926e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036933 Aug 12 11:55:16.980853 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 376/758] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:55:17.264846 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-8e8f448b-e045-41f4-a1ec-2e515c906b7a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:17.265455 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-8e8f448b-e045-41f4-a1ec-2e515c906b7a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:17.271678 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8e8f448b-e045-41f4-a1ec-2e515c906b7a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:17.272245 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8e8f448b-e045-41f4-a1ec-2e515c906b7a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:17.272568 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8e8f448b-e045-41f4-a1ec-2e515c906b7a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:17.273589 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8e8f448b-e045-41f4-a1ec-2e515c906b7a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:17.273926 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8e8f448b-e045-41f4-a1ec-2e515c906b7a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:17.274315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8e8f448b-e045-41f4-a1ec-2e515c906b7a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:17.406082 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-8e8f448b-e045-41f4-a1ec-2e515c906b7a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:17.414351 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-8e8f448b-e045-41f4-a1ec-2e515c906b7a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:17.415922 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-8e8f448b-e045-41f4-a1ec-2e515c906b7a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:17.417073 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-8e8f448b-e045-41f4-a1ec-2e515c906b7a tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1724 microversion: 2.20 time: 0.156148 Aug 12 11:55:17.417636 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 383/759] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:17 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:17.433491 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d9972170-2127-4c30-b162-f2c28023aa86 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:17.434211 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d9972170-2127-4c30-b162-f2c28023aa86 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:17.441491 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d9972170-2127-4c30-b162-f2c28023aa86 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:17.442000 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d9972170-2127-4c30-b162-f2c28023aa86 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:17.442430 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d9972170-2127-4c30-b162-f2c28023aa86 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:17.443144 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d9972170-2127-4c30-b162-f2c28023aa86 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:17.443592 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d9972170-2127-4c30-b162-f2c28023aa86 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:17.444009 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d9972170-2127-4c30-b162-f2c28023aa86 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:17.476057 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d9972170-2127-4c30-b162-f2c28023aa86 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:17.476441 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d9972170-2127-4c30-b162-f2c28023aa86 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:17.476873 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d9972170-2127-4c30-b162-f2c28023aa86 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:17.477317 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.objects.instance [None req-d9972170-2127-4c30-b162-f2c28023aa86 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lazy-loading 'fault' on Instance uuid 5e56c585-652b-4059-b3f6-280d542ee20f {{(pid=132282) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:55:17.520931 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d9972170-2127-4c30-b162-f2c28023aa86 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:17.529015 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-d9972170-2127-4c30-b162-f2c28023aa86 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 200 len: 1311 microversion: 2.1 time: 0.099708 Aug 12 11:55:17.529706 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 377/760] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:55:17 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:55:18.441066 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-fd326bab-98eb-4a20-a403-6165ed2daf67 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:18.441669 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-fd326bab-98eb-4a20-a403-6165ed2daf67 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:18.448176 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fd326bab-98eb-4a20-a403-6165ed2daf67 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:18.448655 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fd326bab-98eb-4a20-a403-6165ed2daf67 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:18.449085 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fd326bab-98eb-4a20-a403-6165ed2daf67 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:18.449763 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fd326bab-98eb-4a20-a403-6165ed2daf67 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:18.450211 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fd326bab-98eb-4a20-a403-6165ed2daf67 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:18.450645 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-fd326bab-98eb-4a20-a403-6165ed2daf67 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:18.549769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-49994bfc-fe03-4cdf-82e0-efc3c09daed6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:18.550580 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-49994bfc-fe03-4cdf-82e0-efc3c09daed6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5e56c585-652b-4059-b3f6-280d542ee20f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:18.556878 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-49994bfc-fe03-4cdf-82e0-efc3c09daed6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:18.557352 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-49994bfc-fe03-4cdf-82e0-efc3c09daed6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:18.557783 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-49994bfc-fe03-4cdf-82e0-efc3c09daed6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:18.558461 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-49994bfc-fe03-4cdf-82e0-efc3c09daed6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:18.558948 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-49994bfc-fe03-4cdf-82e0-efc3c09daed6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:18.559367 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-49994bfc-fe03-4cdf-82e0-efc3c09daed6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:18.573073 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.wsgi [None req-49994bfc-fe03-4cdf-82e0-efc3c09daed6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] HTTP exception thrown: Instance 5e56c585-652b-4059-b3f6-280d542ee20f could not be found. Aug 12 11:55:18.574709 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-49994bfc-fe03-4cdf-82e0-efc3c09daed6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Request method failure captured: Aug 12 11:55:18.574709 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f HTTP/1.1 Aug 12 11:55:18.574709 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 11:55:18.574709 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 11:55:18.574709 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 11:55:18.574709 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 0 Aug 12 11:55:18.574709 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 11:55:18.574709 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 11:55:18.574709 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 11:55:18.574709 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 11:55:18.574709 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9j5mt6PNioe5iUGgp3CAkbSyYo_AhdYrVYhlzDi6Qs9O2Aks8er4C3JcoLHmjMk4ocUEKhdotNj2qgtAdK9WiQzA1AjEiu4Ps5qMdbbFZI3icMtnprp3XMTKgh0QwzwvvdyNK5uaTpRPPinF6P3wPdnin1wNbpohTf1mbuSCDgZlVZU Aug 12 11:55:18.574709 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 11:55:18.574709 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 11:55:18.574709 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 11:55:18.574709 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 11:55:18.574709 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 11:55:18.574709 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 11:55:18.574709 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: a7e2fce9e9db463aa70188453f20d110 Aug 12 11:55:18.574709 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-758473035 Aug 12 11:55:18.574709 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 11:55:18.574709 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 11:55:18.576250 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a7e2fce9e9db463aa70188453f20d110", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a7e2fce9e9db463aa70188453f20d110"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7e2fce9e9db463aa70188453f20d110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7e2fce9e9db463aa70188453f20d110"}]}] Aug 12 11:55:18.576250 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-ServerRescueNegativeTestJSON-758473035 Aug 12 11:55:18.576250 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: a7e2fce9e9db463aa70188453f20d110 Aug 12 11:55:18.576250 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-758473035 Aug 12 11:55:18.576250 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-ServerRescueNegativeTestJSON-758473035-project Aug 12 11:55:18.576250 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 11:55:18.576250 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 11:55:18.576250 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: 64ec7445644e478ca961be80f84f9863 Aug 12 11:55:18.576250 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-ServerRescueNegativeTestJSON-758473035-project Aug 12 11:55:18.576250 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: > Aug 12 11:55:18.576250 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Instance 5e56c585-652b-4059-b3f6-280d542ee20f could not be found. Aug 12 11:55:18.576250 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'id': '5e56c585-652b-4059-b3f6-280d542ee20f'} Aug 12 11:55:18.577672 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:55:18.577672 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:18.577672 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:55:18.577672 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:55:18.577672 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:55:18.577672 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:55:18.577672 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:55:18.577672 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:55:18.577672 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:55:18.577672 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:55:18.577672 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e56c585-652b-4059-b3f6-280d542ee20f could not be found. Aug 12 11:55:18.577672 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:18.577672 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:55:18.577672 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:18.577672 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:18.577672 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:55:18.577672 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:55:18.577672 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:55:18.577672 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:55:18.577672 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:55:18.579315 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:55:18.579315 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:55:18.579315 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:55:18.579315 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:55:18.579315 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:55:18.579315 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:55:18.579315 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:55:18.579315 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e56c585-652b-4059-b3f6-280d542ee20f could not be found. Aug 12 11:55:18.579315 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:18.579315 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:55:18.579315 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:18.579315 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:18.579315 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:55:18.579315 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:55:18.579315 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:55:18.579315 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:55:18.579315 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e56c585-652b-4059-b3f6-280d542ee20f could not be found. Aug 12 11:55:18.579315 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:18.581274 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-49994bfc-fe03-4cdf-82e0-efc3c09daed6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Returning 404 to user: Instance 5e56c585-652b-4059-b3f6-280d542ee20f could not be found. {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:55:18.581274 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-49994bfc-fe03-4cdf-82e0-efc3c09daed6 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f" status: 404 len: 111 microversion: 2.1 time: 0.030262 Aug 12 11:55:18.581274 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 378/761] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:55:18 2022] GET /compute/v2.1/servers/5e56c585-652b-4059-b3f6-280d542ee20f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 11:55:18.581520 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-fd326bab-98eb-4a20-a403-6165ed2daf67 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:18.584980 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-cc43ed85-19c8-427d-b18a-bb9788d957a1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:18.585471 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-cc43ed85-19c8-427d-b18a-bb9788d957a1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:18.588945 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-fd326bab-98eb-4a20-a403-6165ed2daf67 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:18.590435 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-fd326bab-98eb-4a20-a403-6165ed2daf67 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:18.591253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cc43ed85-19c8-427d-b18a-bb9788d957a1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:18.591607 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-fd326bab-98eb-4a20-a403-6165ed2daf67 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1724 microversion: 2.20 time: 0.154392 Aug 12 11:55:18.591755 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cc43ed85-19c8-427d-b18a-bb9788d957a1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:18.592158 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 384/762] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:18 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:18.592273 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cc43ed85-19c8-427d-b18a-bb9788d957a1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:18.592888 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cc43ed85-19c8-427d-b18a-bb9788d957a1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:18.593344 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cc43ed85-19c8-427d-b18a-bb9788d957a1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:18.593772 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cc43ed85-19c8-427d-b18a-bb9788d957a1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:18.618901 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-cc43ed85-19c8-427d-b18a-bb9788d957a1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Going to try to terminate instance {{(pid=132282) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 11:55:18.694089 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-cc43ed85-19c8-427d-b18a-bb9788d957a1 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 204 len: 0 microversion: 2.1 time: 0.112275 Aug 12 11:55:18.695105 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 379/763] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Aug 12 11:55:18 2022] DELETE /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 12 11:55:18.703614 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-539bd345-f2b8-4bc5-bbcd-5f90ad0d5846 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:18.704257 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-539bd345-f2b8-4bc5-bbcd-5f90ad0d5846 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:18.710176 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-539bd345-f2b8-4bc5-bbcd-5f90ad0d5846 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:18.710742 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-539bd345-f2b8-4bc5-bbcd-5f90ad0d5846 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:18.711182 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-539bd345-f2b8-4bc5-bbcd-5f90ad0d5846 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:18.712057 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-539bd345-f2b8-4bc5-bbcd-5f90ad0d5846 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:18.712590 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-539bd345-f2b8-4bc5-bbcd-5f90ad0d5846 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:18.713021 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-539bd345-f2b8-4bc5-bbcd-5f90ad0d5846 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:18.843768 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-539bd345-f2b8-4bc5-bbcd-5f90ad0d5846 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:18.851194 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-539bd345-f2b8-4bc5-bbcd-5f90ad0d5846 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1522 microversion: 2.1 time: 0.151787 Aug 12 11:55:18.851754 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 385/764] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:55:18 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:55:19.614228 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-37b6d4cf-4cb8-4137-a151-e772f4878834 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:19.614969 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-37b6d4cf-4cb8-4137-a151-e772f4878834 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:19.621514 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-37b6d4cf-4cb8-4137-a151-e772f4878834 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:19.621990 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-37b6d4cf-4cb8-4137-a151-e772f4878834 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:19.622422 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-37b6d4cf-4cb8-4137-a151-e772f4878834 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:19.623135 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-37b6d4cf-4cb8-4137-a151-e772f4878834 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:19.623587 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-37b6d4cf-4cb8-4137-a151-e772f4878834 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:19.624007 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-37b6d4cf-4cb8-4137-a151-e772f4878834 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:19.754617 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-37b6d4cf-4cb8-4137-a151-e772f4878834 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:19.762409 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-37b6d4cf-4cb8-4137-a151-e772f4878834 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:19.764489 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-37b6d4cf-4cb8-4137-a151-e772f4878834 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:19.765628 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-37b6d4cf-4cb8-4137-a151-e772f4878834 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1724 microversion: 2.20 time: 0.155678 Aug 12 11:55:19.766204 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 380/765] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:19 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:19.872732 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-8cb3562d-4749-4e64-bc51-4c83df1c61a7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:19.873857 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-8cb3562d-4749-4e64-bc51-4c83df1c61a7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:19.880007 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8cb3562d-4749-4e64-bc51-4c83df1c61a7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:19.880487 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8cb3562d-4749-4e64-bc51-4c83df1c61a7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:19.880949 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8cb3562d-4749-4e64-bc51-4c83df1c61a7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:19.881632 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8cb3562d-4749-4e64-bc51-4c83df1c61a7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:19.882083 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8cb3562d-4749-4e64-bc51-4c83df1c61a7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:19.882500 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8cb3562d-4749-4e64-bc51-4c83df1c61a7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:20.007346 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-8cb3562d-4749-4e64-bc51-4c83df1c61a7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:20.015538 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-8cb3562d-4749-4e64-bc51-4c83df1c61a7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1522 microversion: 2.1 time: 0.146697 Aug 12 11:55:20.016102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 386/766] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:55:19 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:55:20.789450 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-f0e4c408-3c5d-4867-878c-311a88f0a700 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:20.789974 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-f0e4c408-3c5d-4867-878c-311a88f0a700 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:20.798915 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f0e4c408-3c5d-4867-878c-311a88f0a700 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:20.799517 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f0e4c408-3c5d-4867-878c-311a88f0a700 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:20.799960 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f0e4c408-3c5d-4867-878c-311a88f0a700 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:20.800658 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f0e4c408-3c5d-4867-878c-311a88f0a700 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:20.801120 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f0e4c408-3c5d-4867-878c-311a88f0a700 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:20.801545 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f0e4c408-3c5d-4867-878c-311a88f0a700 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:20.927672 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-f0e4c408-3c5d-4867-878c-311a88f0a700 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:20.935694 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-f0e4c408-3c5d-4867-878c-311a88f0a700 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:20.937176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-f0e4c408-3c5d-4867-878c-311a88f0a700 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:20.938340 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-f0e4c408-3c5d-4867-878c-311a88f0a700 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1724 microversion: 2.20 time: 0.154081 Aug 12 11:55:20.938911 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 381/767] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:20 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:21.036917 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-d3e05592-9f47-42cf-8cb1-3e997109bac7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:21.037520 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-d3e05592-9f47-42cf-8cb1-3e997109bac7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:21.044053 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d3e05592-9f47-42cf-8cb1-3e997109bac7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:21.044473 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d3e05592-9f47-42cf-8cb1-3e997109bac7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:21.044904 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d3e05592-9f47-42cf-8cb1-3e997109bac7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:21.045581 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d3e05592-9f47-42cf-8cb1-3e997109bac7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:21.046028 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d3e05592-9f47-42cf-8cb1-3e997109bac7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:21.046443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d3e05592-9f47-42cf-8cb1-3e997109bac7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:21.189123 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-d3e05592-9f47-42cf-8cb1-3e997109bac7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:21.196446 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-d3e05592-9f47-42cf-8cb1-3e997109bac7 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1522 microversion: 2.1 time: 0.163350 Aug 12 11:55:21.196998 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 387/768] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:55:21 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:55:21.960647 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-922751a8-8ef2-455c-9013-94950a3bfb0c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:21.961300 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-922751a8-8ef2-455c-9013-94950a3bfb0c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:21.967567 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-922751a8-8ef2-455c-9013-94950a3bfb0c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:21.968048 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-922751a8-8ef2-455c-9013-94950a3bfb0c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:21.968974 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-922751a8-8ef2-455c-9013-94950a3bfb0c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:21.969648 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-922751a8-8ef2-455c-9013-94950a3bfb0c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:21.970091 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-922751a8-8ef2-455c-9013-94950a3bfb0c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:21.970506 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-922751a8-8ef2-455c-9013-94950a3bfb0c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:22.098176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-922751a8-8ef2-455c-9013-94950a3bfb0c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:22.106174 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-922751a8-8ef2-455c-9013-94950a3bfb0c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:22.107675 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-922751a8-8ef2-455c-9013-94950a3bfb0c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:22.108809 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-922751a8-8ef2-455c-9013-94950a3bfb0c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1724 microversion: 2.20 time: 0.152192 Aug 12 11:55:22.109359 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 382/769] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:21 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:22.216919 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-6759bc5a-ccb9-4484-b65a-6ab618d73bf2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:22.217522 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-6759bc5a-ccb9-4484-b65a-6ab618d73bf2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:22.223904 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6759bc5a-ccb9-4484-b65a-6ab618d73bf2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:22.224383 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6759bc5a-ccb9-4484-b65a-6ab618d73bf2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:22.224818 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6759bc5a-ccb9-4484-b65a-6ab618d73bf2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:22.225499 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6759bc5a-ccb9-4484-b65a-6ab618d73bf2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:22.225949 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6759bc5a-ccb9-4484-b65a-6ab618d73bf2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:22.226367 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6759bc5a-ccb9-4484-b65a-6ab618d73bf2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:22.440412 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-6759bc5a-ccb9-4484-b65a-6ab618d73bf2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ec7445644e478ca961be80f84f9863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2fce9e9db463aa70188453f20d110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:22.447814 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-6759bc5a-ccb9-4484-b65a-6ab618d73bf2 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 200 len: 1522 microversion: 2.1 time: 0.234805 Aug 12 11:55:22.448373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 388/770] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:55:22 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:55:22.833725 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-a659d04e-e078-42ed-a086-afb7e04ae2c8 req-97c5329b-1751-48e5-a66c-d4d00ec74838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5109a18a-e7ab-4ce9-904b-63c1dfc7197a", "name": "network-vif-deleted", "tag": "193da7e7-7328-4dc4-bfb7-5c909c304ee1"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:55:22.842959 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-a659d04e-e078-42ed-a086-afb7e04ae2c8 req-97c5329b-1751-48e5-a66c-d4d00ec74838 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:22.843933 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-a659d04e-e078-42ed-a086-afb7e04ae2c8 req-97c5329b-1751-48e5-a66c-d4d00ec74838 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:22.844364 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-a659d04e-e078-42ed-a086-afb7e04ae2c8 req-97c5329b-1751-48e5-a66c-d4d00ec74838 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:22.854882 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-a659d04e-e078-42ed-a086-afb7e04ae2c8 req-97c5329b-1751-48e5-a66c-d4d00ec74838 service nova] Creating event network-vif-deleted:193da7e7-7328-4dc4-bfb7-5c909c304ee1 for instance 5109a18a-e7ab-4ce9-904b-63c1dfc7197a on hv-cinder-85282 Aug 12 11:55:22.865881 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-a659d04e-e078-42ed-a086-afb7e04ae2c8 req-97c5329b-1751-48e5-a66c-d4d00ec74838 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093447 Aug 12 11:55:22.866535 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 383/771] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:55:23.132065 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-31b2664e-bd30-4e52-9691-b3376d91ed79 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:23.132774 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-31b2664e-bd30-4e52-9691-b3376d91ed79 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:23.139017 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-31b2664e-bd30-4e52-9691-b3376d91ed79 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:23.139607 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-31b2664e-bd30-4e52-9691-b3376d91ed79 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:23.140109 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-31b2664e-bd30-4e52-9691-b3376d91ed79 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:23.140882 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-31b2664e-bd30-4e52-9691-b3376d91ed79 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:23.141400 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-31b2664e-bd30-4e52-9691-b3376d91ed79 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:23.141891 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-31b2664e-bd30-4e52-9691-b3376d91ed79 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:23.277652 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-31b2664e-bd30-4e52-9691-b3376d91ed79 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:23.287119 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-31b2664e-bd30-4e52-9691-b3376d91ed79 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:23.288653 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-31b2664e-bd30-4e52-9691-b3376d91ed79 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:23.290276 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-31b2664e-bd30-4e52-9691-b3376d91ed79 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1724 microversion: 2.20 time: 0.162189 Aug 12 11:55:23.291022 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 389/772] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:23 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:23.470519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-740c94b7-f1d2-4fe7-b38f-e637875bb589 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:23.471180 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-740c94b7-f1d2-4fe7-b38f-e637875bb589 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] [instance: 5109a18a-e7ab-4ce9-904b-63c1dfc7197a] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:23.473085 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:23.478468 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-740c94b7-f1d2-4fe7-b38f-e637875bb589 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:23.478978 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-740c94b7-f1d2-4fe7-b38f-e637875bb589 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:23.479421 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-740c94b7-f1d2-4fe7-b38f-e637875bb589 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:23.480109 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-740c94b7-f1d2-4fe7-b38f-e637875bb589 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:23.480563 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-740c94b7-f1d2-4fe7-b38f-e637875bb589 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:23.480984 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-740c94b7-f1d2-4fe7-b38f-e637875bb589 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:23.496553 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.wsgi [None req-740c94b7-f1d2-4fe7-b38f-e637875bb589 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] HTTP exception thrown: Instance 5109a18a-e7ab-4ce9-904b-63c1dfc7197a could not be found. Aug 12 11:55:23.498183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-740c94b7-f1d2-4fe7-b38f-e637875bb589 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Request method failure captured: Aug 12 11:55:23.498183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a HTTP/1.1 Aug 12 11:55:23.498183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 11:55:23.498183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 11:55:23.498183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 11:55:23.498183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 0 Aug 12 11:55:23.498183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 11:55:23.498183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 11:55:23.498183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 11:55:23.498183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 11:55:23.498183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9j5mt6PNioe5iUGgp3CAkbSyYo_AhdYrVYhlzDi6Qs9O2Aks8er4C3JcoLHmjMk4ocUEKhdotNj2qgtAdK9WiQzA1AjEiu4Ps5qMdbbFZI3icMtnprp3XMTKgh0QwzwvvdyNK5uaTpRPPinF6P3wPdnin1wNbpohTf1mbuSCDgZlVZU Aug 12 11:55:23.498183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 11:55:23.498183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 11:55:23.498183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 11:55:23.498183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 11:55:23.498183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 11:55:23.498183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 11:55:23.498183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: a7e2fce9e9db463aa70188453f20d110 Aug 12 11:55:23.498183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-758473035 Aug 12 11:55:23.498183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 11:55:23.498183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 11:55:23.499646 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a7e2fce9e9db463aa70188453f20d110", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a7e2fce9e9db463aa70188453f20d110"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7e2fce9e9db463aa70188453f20d110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7e2fce9e9db463aa70188453f20d110"}]}] Aug 12 11:55:23.499646 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-ServerRescueNegativeTestJSON-758473035 Aug 12 11:55:23.499646 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: a7e2fce9e9db463aa70188453f20d110 Aug 12 11:55:23.499646 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-758473035 Aug 12 11:55:23.499646 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-ServerRescueNegativeTestJSON-758473035-project Aug 12 11:55:23.499646 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 11:55:23.499646 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 11:55:23.499646 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: 64ec7445644e478ca961be80f84f9863 Aug 12 11:55:23.499646 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-ServerRescueNegativeTestJSON-758473035-project Aug 12 11:55:23.499646 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: > Aug 12 11:55:23.499646 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Instance 5109a18a-e7ab-4ce9-904b-63c1dfc7197a could not be found. Aug 12 11:55:23.499646 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'id': '5109a18a-e7ab-4ce9-904b-63c1dfc7197a'} Aug 12 11:55:23.500372 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:55:23.500372 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:23.500372 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:55:23.500372 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:55:23.500372 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:55:23.500372 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:55:23.500372 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:55:23.500372 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:55:23.500372 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:55:23.500372 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:55:23.500372 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5109a18a-e7ab-4ce9-904b-63c1dfc7197a could not be found. Aug 12 11:55:23.500372 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:23.500372 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:55:23.500372 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:23.500372 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:23.500372 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:55:23.500372 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:55:23.500372 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:55:23.500372 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:55:23.500372 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:55:23.501889 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:55:23.501889 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:55:23.501889 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:55:23.501889 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:55:23.501889 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:55:23.501889 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:55:23.501889 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:55:23.501889 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5109a18a-e7ab-4ce9-904b-63c1dfc7197a could not be found. Aug 12 11:55:23.501889 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:23.501889 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:55:23.501889 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:23.501889 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:23.501889 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:55:23.501889 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:55:23.501889 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:55:23.501889 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:55:23.501889 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5109a18a-e7ab-4ce9-904b-63c1dfc7197a could not be found. Aug 12 11:55:23.501889 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:23.503197 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-740c94b7-f1d2-4fe7-b38f-e637875bb589 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] Returning 404 to user: Instance 5109a18a-e7ab-4ce9-904b-63c1dfc7197a could not be found. {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:55:23.503197 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-740c94b7-f1d2-4fe7-b38f-e637875bb589 tempest-ServerRescueNegativeTestJSON-758473035 tempest-ServerRescueNegativeTestJSON-758473035-project] 10.222.0.42 "GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a" status: 404 len: 111 microversion: 2.1 time: 0.034334 Aug 12 11:55:23.503197 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 384/773] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:55:23 2022] GET /compute/v2.1/servers/5109a18a-e7ab-4ce9-904b-63c1dfc7197a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:55:24.313961 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-71e7b1e0-e460-427b-a689-5548f8b1fabf tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:24.314587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-71e7b1e0-e460-427b-a689-5548f8b1fabf tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:24.320918 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-71e7b1e0-e460-427b-a689-5548f8b1fabf tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:24.321391 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-71e7b1e0-e460-427b-a689-5548f8b1fabf tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:24.321815 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-71e7b1e0-e460-427b-a689-5548f8b1fabf tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:24.322494 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-71e7b1e0-e460-427b-a689-5548f8b1fabf tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:24.322967 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-71e7b1e0-e460-427b-a689-5548f8b1fabf tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:24.323388 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-71e7b1e0-e460-427b-a689-5548f8b1fabf tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:24.533705 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-71e7b1e0-e460-427b-a689-5548f8b1fabf tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:24.542235 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-71e7b1e0-e460-427b-a689-5548f8b1fabf tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:24.544073 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-71e7b1e0-e460-427b-a689-5548f8b1fabf tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:24.545622 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-71e7b1e0-e460-427b-a689-5548f8b1fabf tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1724 microversion: 2.20 time: 0.236252 Aug 12 11:55:24.546380 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 390/774] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:24 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:25.573871 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-a81501df-efe5-4fc2-87ad-aaec8e065360 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:25.574792 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-a81501df-efe5-4fc2-87ad-aaec8e065360 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:25.580949 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a81501df-efe5-4fc2-87ad-aaec8e065360 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:25.581524 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a81501df-efe5-4fc2-87ad-aaec8e065360 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:25.582051 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a81501df-efe5-4fc2-87ad-aaec8e065360 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:25.582965 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a81501df-efe5-4fc2-87ad-aaec8e065360 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:25.583748 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a81501df-efe5-4fc2-87ad-aaec8e065360 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:25.584179 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a81501df-efe5-4fc2-87ad-aaec8e065360 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:25.588885 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:25.793719 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-a81501df-efe5-4fc2-87ad-aaec8e065360 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:25.802792 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-a81501df-efe5-4fc2-87ad-aaec8e065360 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:25.804599 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-a81501df-efe5-4fc2-87ad-aaec8e065360 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:25.805499 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-a81501df-efe5-4fc2-87ad-aaec8e065360 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1724 microversion: 2.20 time: 0.236864 Aug 12 11:55:25.806147 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 385/775] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:25 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:55:26.829971 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e9b5d634-81e7-4f6a-a401-0efa9361e703 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:26.830548 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-e9b5d634-81e7-4f6a-a401-0efa9361e703 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:26.838628 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e9b5d634-81e7-4f6a-a401-0efa9361e703 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:26.839133 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e9b5d634-81e7-4f6a-a401-0efa9361e703 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:26.839787 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e9b5d634-81e7-4f6a-a401-0efa9361e703 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:26.840432 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e9b5d634-81e7-4f6a-a401-0efa9361e703 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:26.840896 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e9b5d634-81e7-4f6a-a401-0efa9361e703 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:26.841480 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e9b5d634-81e7-4f6a-a401-0efa9361e703 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:26.999223 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-e9b5d634-81e7-4f6a-a401-0efa9361e703 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:27.007748 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-e9b5d634-81e7-4f6a-a401-0efa9361e703 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:27.009236 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-e9b5d634-81e7-4f6a-a401-0efa9361e703 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:27.010386 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-e9b5d634-81e7-4f6a-a401-0efa9361e703 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1724 microversion: 2.20 time: 0.185854 Aug 12 11:55:27.011142 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 391/776] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:26 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:55:27.957087 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-35105a67-2bb4-41a8-b4f0-82166b7da0d0 tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] Action: 'create', calling method: .version_select at 0x7f3e5827b5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1367090619", "metadata": {"Type": "work"}}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:55:27.974981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-35105a67-2bb4-41a8-b4f0-82166b7da0d0 tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] Request method failure captured: Aug 12 11:55:27.974981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 12 11:55:27.974981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 11:55:27.974981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 11:55:27.974981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 11:55:27.974981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 122 Aug 12 11:55:27.974981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 11:55:27.974981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 11:55:27.974981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 11:55:27.974981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 11:55:27.974981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9j-vWlfa0I0wD-z6FWFxlBzId_HDNcFcjtYCujV7pAluC7qtBnYTNM32SxWaD7Id2AHczefsGu0KUKPpxZdOcs2I6CGBA76JbVD-UYfshmRxjpf6QCFs8N2LK2rREqm9m0bbHUtUIFzu0dn34VV_BEq6c_UxkkTyK3yWSND7UU2c54g Aug 12 11:55:27.974981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 11:55:27.974981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 11:55:27.974981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 11:55:27.974981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 11:55:27.974981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 11:55:27.974981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 11:55:27.974981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: da41e9c7c960402396a7896a395623a7 Aug 12 11:55:27.974981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-VolumesNegativeTest-69365559 Aug 12 11:55:27.974981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 11:55:27.974981 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 11:55:27.976585 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_da41e9c7c960402396a7896a395623a7", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/da41e9c7c960402396a7896a395623a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/da41e9c7c960402396a7896a395623a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/da41e9c7c960402396a7896a395623a7"}]}] Aug 12 11:55:27.976585 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-VolumesNegativeTest-69365559 Aug 12 11:55:27.976585 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: da41e9c7c960402396a7896a395623a7 Aug 12 11:55:27.976585 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-VolumesNegativeTest-69365559 Aug 12 11:55:27.976585 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-VolumesNegativeTest-69365559-project Aug 12 11:55:27.976585 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 11:55:27.976585 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 11:55:27.976585 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: 631a59cbafa4494c9238f21bfc3623c7 Aug 12 11:55:27.976585 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-VolumesNegativeTest-69365559-project Aug 12 11:55:27.976585 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Aug 12 11:55:27.976585 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1367090619", "metadata": {"Type": "work"}}} Aug 12 11:55:27.976585 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: Aug 12 11:55:27.976585 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 12 11:55:27.977532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1367090619', 'metadata': {'Type': 'work'}}}} Aug 12 11:55:27.977532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:55:27.977532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:27.977532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 12 11:55:27.977532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 12 11:55:27.977532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 12 11:55:27.977532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise error Aug 12 11:55:27.977532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 12 11:55:27.977532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:27.977532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 12 11:55:27.977532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 12 11:55:27.977532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:27.977532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 12 11:55:27.977532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi '#$%' Aug 12 11:55:27.977532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:27.977532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:55:27.977532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:27.977532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:27.977532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:55:27.977532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:55:27.977532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:55:27.977532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:55:27.979120 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 11:55:27.979120 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 11:55:27.979120 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:55:27.979120 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:55:27.979120 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 12 11:55:27.979120 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 12 11:55:27.979120 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 12 11:55:27.979120 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 12 11:55:27.979120 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 12 11:55:27.979120 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 12 11:55:27.979120 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 12 11:55:27.979120 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:27.979120 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:55:27.979120 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:27.979120 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:27.979120 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:55:27.979120 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:55:27.979120 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 12 11:55:27.979120 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 12 11:55:27.980293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 12 11:55:27.980293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:27.980293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-35105a67-2bb4-41a8-b4f0-82166b7da0d0 tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:55:27.980293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-35105a67-2bb4-41a8-b4f0-82166b7da0d0 tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.129250 Aug 12 11:55:27.980293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 386/777] 10.222.0.42 () {60 vars in 1156 bytes} [Fri Aug 12 11:55:27 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 12 11:55:27.986257 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-6db785a1-0df8-424e-a372-241bcb31b56b tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] Action: 'create', calling method: .version_select at 0x7f3e4bfee4c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-325854722", "metadata": {"Type": "work"}}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:55:27.990969 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-6db785a1-0df8-424e-a372-241bcb31b56b tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] Request method failure captured: Aug 12 11:55:27.990969 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 12 11:55:27.990969 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 11:55:27.990969 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 11:55:27.990969 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 11:55:27.990969 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 119 Aug 12 11:55:27.990969 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 11:55:27.990969 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 11:55:27.990969 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 11:55:27.990969 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 11:55:27.990969 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9j-vWlfa0I0wD-z6FWFxlBzId_HDNcFcjtYCujV7pAluC7qtBnYTNM32SxWaD7Id2AHczefsGu0KUKPpxZdOcs2I6CGBA76JbVD-UYfshmRxjpf6QCFs8N2LK2rREqm9m0bbHUtUIFzu0dn34VV_BEq6c_UxkkTyK3yWSND7UU2c54g Aug 12 11:55:27.990969 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 11:55:27.990969 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 11:55:27.990969 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 11:55:27.990969 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 11:55:27.990969 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 11:55:27.990969 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 11:55:27.990969 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: da41e9c7c960402396a7896a395623a7 Aug 12 11:55:27.990969 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-VolumesNegativeTest-69365559 Aug 12 11:55:27.990969 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 11:55:27.990969 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 11:55:27.992423 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_da41e9c7c960402396a7896a395623a7", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/da41e9c7c960402396a7896a395623a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/da41e9c7c960402396a7896a395623a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/da41e9c7c960402396a7896a395623a7"}]}] Aug 12 11:55:27.992423 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-VolumesNegativeTest-69365559 Aug 12 11:55:27.992423 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: da41e9c7c960402396a7896a395623a7 Aug 12 11:55:27.992423 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-VolumesNegativeTest-69365559 Aug 12 11:55:27.992423 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-VolumesNegativeTest-69365559-project Aug 12 11:55:27.992423 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 11:55:27.992423 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 11:55:27.992423 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: 631a59cbafa4494c9238f21bfc3623c7 Aug 12 11:55:27.992423 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-VolumesNegativeTest-69365559-project Aug 12 11:55:27.992423 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Aug 12 11:55:27.992423 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-325854722", "metadata": {"Type": "work"}}} Aug 12 11:55:27.992423 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: Aug 12 11:55:27.992423 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 12 11:55:27.993449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-325854722', 'metadata': {'Type': 'work'}}}} Aug 12 11:55:27.993449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:55:27.993449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:27.993449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 12 11:55:27.993449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 12 11:55:27.993449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 12 11:55:27.993449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise error Aug 12 11:55:27.993449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 12 11:55:27.993449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:55:27.993449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 12 11:55:27.993449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 12 11:55:27.993449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:55:27.993449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 12 11:55:27.993449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi '0' Aug 12 11:55:27.993449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:55:27.993449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:55:27.993449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:55:27.993449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:27.993449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:55:27.993449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:55:27.993449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:55:27.993449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:55:27.995129 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 11:55:27.995129 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 11:55:27.995129 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:55:27.995129 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:55:27.995129 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 12 11:55:27.995129 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 12 11:55:27.995129 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 12 11:55:27.995129 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 12 11:55:27.995129 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 12 11:55:27.995129 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 12 11:55:27.995129 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 12 11:55:27.995129 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:55:27.995129 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:55:27.995129 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:55:27.995129 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:27.995129 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:55:27.995129 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:55:27.995129 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 12 11:55:27.995129 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 12 11:55:27.996619 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 12 11:55:27.996619 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:55:27.996619 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-6db785a1-0df8-424e-a372-241bcb31b56b tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:55:27.996619 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-6db785a1-0df8-424e-a372-241bcb31b56b tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010114 Aug 12 11:55:27.996619 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 392/778] 10.222.0.42 () {60 vars in 1156 bytes} [Fri Aug 12 11:55:27 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 12 11:55:28.001623 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-5abe9efb-3e23-46fd-a43e-58036df2aa59 tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] Action: 'create', calling method: .version_select at 0x7f3e5cac1ca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1203854348", "metadata": {"Type": "work"}}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:55:28.005792 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-5abe9efb-3e23-46fd-a43e-58036df2aa59 tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] Request method failure captured: Aug 12 11:55:28.005792 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 12 11:55:28.005792 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 11:55:28.005792 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 11:55:28.005792 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 11:55:28.005792 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 119 Aug 12 11:55:28.005792 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 11:55:28.005792 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 11:55:28.005792 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 11:55:28.005792 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 11:55:28.005792 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9j-vWlfa0I0wD-z6FWFxlBzId_HDNcFcjtYCujV7pAluC7qtBnYTNM32SxWaD7Id2AHczefsGu0KUKPpxZdOcs2I6CGBA76JbVD-UYfshmRxjpf6QCFs8N2LK2rREqm9m0bbHUtUIFzu0dn34VV_BEq6c_UxkkTyK3yWSND7UU2c54g Aug 12 11:55:28.005792 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 11:55:28.005792 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 11:55:28.005792 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 11:55:28.005792 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 11:55:28.005792 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 11:55:28.005792 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 11:55:28.005792 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: da41e9c7c960402396a7896a395623a7 Aug 12 11:55:28.005792 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-VolumesNegativeTest-69365559 Aug 12 11:55:28.005792 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 11:55:28.005792 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 11:55:28.007411 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_da41e9c7c960402396a7896a395623a7", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/da41e9c7c960402396a7896a395623a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/da41e9c7c960402396a7896a395623a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/da41e9c7c960402396a7896a395623a7"}]}] Aug 12 11:55:28.007411 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-VolumesNegativeTest-69365559 Aug 12 11:55:28.007411 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: da41e9c7c960402396a7896a395623a7 Aug 12 11:55:28.007411 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-VolumesNegativeTest-69365559 Aug 12 11:55:28.007411 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-VolumesNegativeTest-69365559-project Aug 12 11:55:28.007411 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 11:55:28.007411 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 11:55:28.007411 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: 631a59cbafa4494c9238f21bfc3623c7 Aug 12 11:55:28.007411 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-VolumesNegativeTest-69365559-project Aug 12 11:55:28.007411 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Aug 12 11:55:28.007411 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1203854348", "metadata": {"Type": "work"}}} Aug 12 11:55:28.007411 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: Aug 12 11:55:28.007411 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 12 11:55:28.008449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1203854348', 'metadata': {'Type': 'work'}}}} Aug 12 11:55:28.008449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:55:28.008449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:28.008449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 12 11:55:28.008449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 12 11:55:28.008449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 12 11:55:28.008449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise error Aug 12 11:55:28.008449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 12 11:55:28.008449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:28.008449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 12 11:55:28.008449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 12 11:55:28.008449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:28.008449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 12 11:55:28.008449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi '' Aug 12 11:55:28.008449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:28.008449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:55:28.008449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:28.008449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:28.008449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:55:28.008449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:55:28.008449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:55:28.008449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:55:28.010036 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 11:55:28.010036 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 11:55:28.010036 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:55:28.010036 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:55:28.010036 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 12 11:55:28.010036 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 12 11:55:28.010036 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 12 11:55:28.010036 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 12 11:55:28.010036 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 12 11:55:28.010036 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 12 11:55:28.010036 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 12 11:55:28.010036 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:28.010036 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:55:28.010036 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:28.010036 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:28.010036 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:55:28.010036 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:55:28.010036 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 12 11:55:28.010036 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 12 11:55:28.011446 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 12 11:55:28.011446 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:55:28.011446 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-5abe9efb-3e23-46fd-a43e-58036df2aa59 tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:55:28.011446 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-5abe9efb-3e23-46fd-a43e-58036df2aa59 tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009710 Aug 12 11:55:28.011446 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 387/779] 10.222.0.42 () {60 vars in 1156 bytes} [Fri Aug 12 11:55:27 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 12 11:55:28.016455 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-de95a7f0-77fa-43b0-82e6-f74e5bbe7d38 tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] Calling method '.version_select at 0x7f3e5820a9d0>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:28.034207 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-8b1b087d-f5e0-4f07-a3c2-fd1b0b47d7b7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:28.034847 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-8b1b087d-f5e0-4f07-a3c2-fd1b0b47d7b7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:28.042453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8b1b087d-f5e0-4f07-a3c2-fd1b0b47d7b7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:28.043104 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8b1b087d-f5e0-4f07-a3c2-fd1b0b47d7b7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:28.043847 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8b1b087d-f5e0-4f07-a3c2-fd1b0b47d7b7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:28.044977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8b1b087d-f5e0-4f07-a3c2-fd1b0b47d7b7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:28.045712 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8b1b087d-f5e0-4f07-a3c2-fd1b0b47d7b7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:28.046394 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8b1b087d-f5e0-4f07-a3c2-fd1b0b47d7b7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:28.048260 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.wsgi [None req-de95a7f0-77fa-43b0-82e6-f74e5bbe7d38 tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] HTTP exception thrown: Volume tempest-invalid-2109951015 could not be found. Aug 12 11:55:28.050192 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-de95a7f0-77fa-43b0-82e6-f74e5bbe7d38 tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] Request method failure captured: Aug 12 11:55:28.050192 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2109951015 HTTP/1.1 Aug 12 11:55:28.050192 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 11:55:28.050192 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 11:55:28.050192 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 11:55:28.050192 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 0 Aug 12 11:55:28.050192 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 11:55:28.050192 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 11:55:28.050192 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 11:55:28.050192 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 11:55:28.050192 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9j-vWlfa0I0wD-z6FWFxlBzId_HDNcFcjtYCujV7pAluC7qtBnYTNM32SxWaD7Id2AHczefsGu0KUKPpxZdOcs2I6CGBA76JbVD-UYfshmRxjpf6QCFs8N2LK2rREqm9m0bbHUtUIFzu0dn34VV_BEq6c_UxkkTyK3yWSND7UU2c54g Aug 12 11:55:28.050192 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 11:55:28.050192 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 11:55:28.050192 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 11:55:28.050192 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 11:55:28.050192 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 11:55:28.050192 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 11:55:28.050192 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: da41e9c7c960402396a7896a395623a7 Aug 12 11:55:28.050192 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-VolumesNegativeTest-69365559 Aug 12 11:55:28.050192 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 11:55:28.050192 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 11:55:28.051581 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_da41e9c7c960402396a7896a395623a7", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/da41e9c7c960402396a7896a395623a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/da41e9c7c960402396a7896a395623a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/da41e9c7c960402396a7896a395623a7"}]}] Aug 12 11:55:28.051581 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-VolumesNegativeTest-69365559 Aug 12 11:55:28.051581 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: da41e9c7c960402396a7896a395623a7 Aug 12 11:55:28.051581 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-VolumesNegativeTest-69365559 Aug 12 11:55:28.051581 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-VolumesNegativeTest-69365559-project Aug 12 11:55:28.051581 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 11:55:28.051581 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 11:55:28.051581 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: 631a59cbafa4494c9238f21bfc3623c7 Aug 12 11:55:28.051581 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-VolumesNegativeTest-69365559-project Aug 12 11:55:28.051581 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: Aug 12 11:55:28.051581 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Volume tempest-invalid-2109951015 could not be found. Aug 12 11:55:28.051581 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'id': 'tempest-invalid-2109951015'} Aug 12 11:55:28.051581 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:55:28.052372 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:28.052372 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 11:55:28.052372 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 11:55:28.052372 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 11:55:28.052372 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 11:55:28.052372 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 11:55:28.052372 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 11:55:28.052372 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 11:55:28.052372 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 11:55:28.052372 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 11:55:28.052372 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 11:55:28.052372 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 11:55:28.052372 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 11:55:28.052372 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 11:55:28.052372 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 11:55:28.052372 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2109951015 could not be found. (HTTP 404) (Request-ID: req-cccf681d-0299-4ee5-a0ed-b470652538a2) Aug 12 11:55:28.052372 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:55:28.052372 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:55:28.052372 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:55:28.053809 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:28.053809 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 12 11:55:28.053809 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 12 11:55:28.053809 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 11:55:28.053809 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 11:55:28.053809 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 11:55:28.053809 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 11:55:28.053809 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 11:55:28.053809 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 11:55:28.053809 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 11:55:28.053809 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 11:55:28.053809 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 11:55:28.053809 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 11:55:28.053809 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 11:55:28.053809 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 11:55:28.053809 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 11:55:28.053809 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 11:55:28.053809 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 11:55:28.053809 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 11:55:28.055587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 11:55:28.055587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 11:55:28.055587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 11:55:28.055587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 11:55:28.055587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2109951015 could not be found. Aug 12 11:55:28.055587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:55:28.055587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:55:28.055587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:55:28.055587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:28.055587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:55:28.055587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:55:28.055587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:55:28.055587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:55:28.055587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 11:55:28.055587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 11:55:28.055587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:55:28.055587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:55:28.055587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 12 11:55:28.055587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:55:28.055587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2109951015 could not be found. Aug 12 11:55:28.057586 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:55:28.057586 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:55:28.057586 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:55:28.057586 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:28.057586 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:55:28.057586 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:55:28.057586 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:55:28.057586 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:55:28.057586 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2109951015 could not be found. Aug 12 11:55:28.057586 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:55:28.057586 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-de95a7f0-77fa-43b0-82e6-f74e5bbe7d38 tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] Returning 404 to user: Volume tempest-invalid-2109951015 could not be found. {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:55:28.057586 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-de95a7f0-77fa-43b0-82e6-f74e5bbe7d38 tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2109951015" status: 404 len: 99 microversion: 2.1 time: 0.039487 Aug 12 11:55:28.057586 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 393/780] 10.222.0.42 () {58 vars in 1218 bytes} [Fri Aug 12 11:55:28 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2109951015 => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 12 11:55:28.061438 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-0530c851-1c65-4f88-b4cd-2499deee2bac tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003809 Aug 12 11:55:28.061926 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 394/781] 10.222.0.42 () {58 vars in 1140 bytes} [Fri Aug 12 11:55:28 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 12 11:55:28.070421 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-86fea60d-7ddf-4b77-846f-67f7abb14184 tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003535 Aug 12 11:55:28.071213 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 395/782] 10.222.0.42 () {58 vars in 1137 bytes} [Fri Aug 12 11:55:28 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 12 11:55:28.079765 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e7004f0b-d9f5-466b-bc94-c2babfae486f tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] Calling method '.version_select at 0x7f3e4bfba0d0>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:28.108269 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.wsgi [None req-e7004f0b-d9f5-466b-bc94-c2babfae486f tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] HTTP exception thrown: Volume ef789710-a05d-41c2-bef7-96f5807bd4b0 could not be found. Aug 12 11:55:28.110186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e7004f0b-d9f5-466b-bc94-c2babfae486f tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] Request method failure captured: Aug 12 11:55:28.110186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: DELETE /compute/v2.1/os-volumes/ef789710-a05d-41c2-bef7-96f5807bd4b0 HTTP/1.1 Aug 12 11:55:28.110186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 11:55:28.110186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 11:55:28.110186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 11:55:28.110186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 0 Aug 12 11:55:28.110186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 11:55:28.110186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 11:55:28.110186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 11:55:28.110186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 11:55:28.110186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9j-vWlfa0I0wD-z6FWFxlBzId_HDNcFcjtYCujV7pAluC7qtBnYTNM32SxWaD7Id2AHczefsGu0KUKPpxZdOcs2I6CGBA76JbVD-UYfshmRxjpf6QCFs8N2LK2rREqm9m0bbHUtUIFzu0dn34VV_BEq6c_UxkkTyK3yWSND7UU2c54g Aug 12 11:55:28.110186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 11:55:28.110186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 11:55:28.110186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 11:55:28.110186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 11:55:28.110186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 11:55:28.110186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 11:55:28.110186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: da41e9c7c960402396a7896a395623a7 Aug 12 11:55:28.110186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-VolumesNegativeTest-69365559 Aug 12 11:55:28.110186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 11:55:28.110186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 11:55:28.111588 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_da41e9c7c960402396a7896a395623a7", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/da41e9c7c960402396a7896a395623a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/da41e9c7c960402396a7896a395623a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/da41e9c7c960402396a7896a395623a7"}]}] Aug 12 11:55:28.111588 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-VolumesNegativeTest-69365559 Aug 12 11:55:28.111588 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: da41e9c7c960402396a7896a395623a7 Aug 12 11:55:28.111588 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-VolumesNegativeTest-69365559 Aug 12 11:55:28.111588 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-VolumesNegativeTest-69365559-project Aug 12 11:55:28.111588 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 11:55:28.111588 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 11:55:28.111588 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: 631a59cbafa4494c9238f21bfc3623c7 Aug 12 11:55:28.111588 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-VolumesNegativeTest-69365559-project Aug 12 11:55:28.111588 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: Aug 12 11:55:28.111588 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Volume ef789710-a05d-41c2-bef7-96f5807bd4b0 could not be found. Aug 12 11:55:28.111588 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'id': 'ef789710-a05d-41c2-bef7-96f5807bd4b0'} Aug 12 11:55:28.111588 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:55:28.112392 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:28.112392 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 11:55:28.112392 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 11:55:28.112392 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 11:55:28.112392 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 11:55:28.112392 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 11:55:28.112392 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 11:55:28.112392 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 11:55:28.112392 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 11:55:28.112392 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 11:55:28.112392 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 11:55:28.112392 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 11:55:28.112392 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 11:55:28.112392 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 11:55:28.112392 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 11:55:28.112392 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ef789710-a05d-41c2-bef7-96f5807bd4b0 could not be found. (HTTP 404) (Request-ID: req-f8d1d635-bf3d-465c-b00e-279ca149463d) Aug 12 11:55:28.112392 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:55:28.112392 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:55:28.112392 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:55:28.113708 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:28.113708 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 12 11:55:28.113708 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 12 11:55:28.113708 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 11:55:28.113708 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 11:55:28.113708 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 11:55:28.113708 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 11:55:28.113708 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 11:55:28.113708 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 11:55:28.113708 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 11:55:28.113708 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 11:55:28.113708 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 11:55:28.113708 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 11:55:28.113708 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 11:55:28.113708 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 11:55:28.113708 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 11:55:28.113708 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 11:55:28.113708 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 11:55:28.113708 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 11:55:28.115222 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 11:55:28.115222 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 11:55:28.115222 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 11:55:28.115222 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 11:55:28.115222 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ef789710-a05d-41c2-bef7-96f5807bd4b0 could not be found. Aug 12 11:55:28.115222 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:55:28.115222 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:55:28.115222 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:55:28.115222 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:28.115222 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:55:28.115222 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:55:28.115222 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:55:28.115222 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:55:28.115222 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 11:55:28.115222 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 11:55:28.115222 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:55:28.115222 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:55:28.115222 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 12 11:55:28.115222 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:55:28.116553 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ef789710-a05d-41c2-bef7-96f5807bd4b0 could not be found. Aug 12 11:55:28.116553 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:55:28.116553 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:55:28.116553 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:55:28.116553 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:28.116553 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:55:28.116553 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:55:28.116553 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:55:28.116553 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:55:28.116553 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ef789710-a05d-41c2-bef7-96f5807bd4b0 could not be found. Aug 12 11:55:28.116553 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:55:28.116553 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e7004f0b-d9f5-466b-bc94-c2babfae486f tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] Returning 404 to user: Volume ef789710-a05d-41c2-bef7-96f5807bd4b0 could not be found. {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:55:28.116553 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-e7004f0b-d9f5-466b-bc94-c2babfae486f tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/ef789710-a05d-41c2-bef7-96f5807bd4b0" status: 404 len: 109 microversion: 2.1 time: 0.035940 Aug 12 11:55:28.116553 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 396/783] 10.222.0.42 () {58 vars in 1248 bytes} [Fri Aug 12 11:55:28 2022] DELETE /compute/v2.1/os-volumes/ef789710-a05d-41c2-bef7-96f5807bd4b0 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 11:55:28.120733 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-40afcdeb-9016-49ae-acd7-c01fb713ea5f tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] Calling method '.version_select at 0x7f3e58039b80>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:28.150361 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.wsgi [None req-40afcdeb-9016-49ae-acd7-c01fb713ea5f tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] HTTP exception thrown: Volume ad9aedbf-a7a2-457c-94dd-63e200829c8e could not be found. Aug 12 11:55:28.152383 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-40afcdeb-9016-49ae-acd7-c01fb713ea5f tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] Request method failure captured: Aug 12 11:55:28.152383 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: GET /compute/v2.1/os-volumes/ad9aedbf-a7a2-457c-94dd-63e200829c8e HTTP/1.1 Aug 12 11:55:28.152383 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 11:55:28.152383 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 11:55:28.152383 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 11:55:28.152383 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 0 Aug 12 11:55:28.152383 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 11:55:28.152383 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 11:55:28.152383 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 11:55:28.152383 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 11:55:28.152383 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9j-vWlfa0I0wD-z6FWFxlBzId_HDNcFcjtYCujV7pAluC7qtBnYTNM32SxWaD7Id2AHczefsGu0KUKPpxZdOcs2I6CGBA76JbVD-UYfshmRxjpf6QCFs8N2LK2rREqm9m0bbHUtUIFzu0dn34VV_BEq6c_UxkkTyK3yWSND7UU2c54g Aug 12 11:55:28.152383 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 11:55:28.152383 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 11:55:28.152383 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 11:55:28.152383 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 11:55:28.152383 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 11:55:28.152383 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 11:55:28.152383 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: da41e9c7c960402396a7896a395623a7 Aug 12 11:55:28.152383 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-VolumesNegativeTest-69365559 Aug 12 11:55:28.152383 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 11:55:28.152383 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 11:55:28.153922 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_da41e9c7c960402396a7896a395623a7", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/da41e9c7c960402396a7896a395623a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/da41e9c7c960402396a7896a395623a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/da41e9c7c960402396a7896a395623a7"}]}] Aug 12 11:55:28.153922 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-VolumesNegativeTest-69365559 Aug 12 11:55:28.153922 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: da41e9c7c960402396a7896a395623a7 Aug 12 11:55:28.153922 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-VolumesNegativeTest-69365559 Aug 12 11:55:28.153922 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-VolumesNegativeTest-69365559-project Aug 12 11:55:28.153922 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 11:55:28.153922 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 11:55:28.153922 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: 631a59cbafa4494c9238f21bfc3623c7 Aug 12 11:55:28.153922 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-VolumesNegativeTest-69365559-project Aug 12 11:55:28.153922 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: Aug 12 11:55:28.153922 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Volume ad9aedbf-a7a2-457c-94dd-63e200829c8e could not be found. Aug 12 11:55:28.153922 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'id': 'ad9aedbf-a7a2-457c-94dd-63e200829c8e'} Aug 12 11:55:28.153922 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:55:28.154762 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:28.154762 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 11:55:28.154762 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 11:55:28.154762 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 11:55:28.154762 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 11:55:28.154762 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 11:55:28.154762 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 11:55:28.154762 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 11:55:28.154762 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 11:55:28.154762 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 11:55:28.154762 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 11:55:28.154762 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 11:55:28.154762 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 11:55:28.154762 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 11:55:28.154762 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 11:55:28.154762 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad9aedbf-a7a2-457c-94dd-63e200829c8e could not be found. (HTTP 404) (Request-ID: req-2a98145c-e98e-435c-b3be-383cbbe32261) Aug 12 11:55:28.154762 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:55:28.154762 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:55:28.154762 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:55:28.156143 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:28.156143 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 12 11:55:28.156143 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 12 11:55:28.156143 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 11:55:28.156143 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 11:55:28.156143 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 11:55:28.156143 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 11:55:28.156143 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 11:55:28.156143 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 11:55:28.156143 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 11:55:28.156143 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 11:55:28.156143 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 11:55:28.156143 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 11:55:28.156143 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 11:55:28.156143 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 11:55:28.156143 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 11:55:28.156143 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 11:55:28.156143 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 11:55:28.156143 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 11:55:28.157610 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 11:55:28.157610 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 11:55:28.157610 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 11:55:28.157610 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 11:55:28.157610 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad9aedbf-a7a2-457c-94dd-63e200829c8e could not be found. Aug 12 11:55:28.157610 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:55:28.157610 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:55:28.157610 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:55:28.157610 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:28.157610 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:55:28.157610 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:55:28.157610 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:55:28.157610 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:55:28.157610 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 11:55:28.157610 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 11:55:28.157610 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:55:28.157610 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:55:28.157610 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 12 11:55:28.157610 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:55:28.159009 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad9aedbf-a7a2-457c-94dd-63e200829c8e could not be found. Aug 12 11:55:28.159009 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:55:28.159009 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:55:28.159009 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:55:28.159009 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:55:28.159009 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:55:28.159009 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:55:28.159009 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:55:28.159009 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:55:28.159009 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad9aedbf-a7a2-457c-94dd-63e200829c8e could not be found. Aug 12 11:55:28.159009 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:55:28.159009 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-40afcdeb-9016-49ae-acd7-c01fb713ea5f tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] Returning 404 to user: Volume ad9aedbf-a7a2-457c-94dd-63e200829c8e could not be found. {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:55:28.159009 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-40afcdeb-9016-49ae-acd7-c01fb713ea5f tempest-VolumesNegativeTest-69365559 tempest-VolumesNegativeTest-69365559-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/ad9aedbf-a7a2-457c-94dd-63e200829c8e" status: 404 len: 109 microversion: 2.1 time: 0.036540 Aug 12 11:55:28.159009 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 397/784] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Aug 12 11:55:28 2022] GET /compute/v2.1/os-volumes/ad9aedbf-a7a2-457c-94dd-63e200829c8e => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:55:28.206873 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-8b1b087d-f5e0-4f07-a3c2-fd1b0b47d7b7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:28.214786 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-8b1b087d-f5e0-4f07-a3c2-fd1b0b47d7b7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:28.216277 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-8b1b087d-f5e0-4f07-a3c2-fd1b0b47d7b7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:28.217560 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-8b1b087d-f5e0-4f07-a3c2-fd1b0b47d7b7 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1724 microversion: 2.20 time: 0.188022 Aug 12 11:55:28.218114 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 388/785] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:28 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:55:29.240749 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-cedab646-91fc-4ce2-b08e-317ef7058c7e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:29.241244 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-cedab646-91fc-4ce2-b08e-317ef7058c7e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:29.246788 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cedab646-91fc-4ce2-b08e-317ef7058c7e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:29.247381 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cedab646-91fc-4ce2-b08e-317ef7058c7e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:29.247694 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cedab646-91fc-4ce2-b08e-317ef7058c7e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:29.248381 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cedab646-91fc-4ce2-b08e-317ef7058c7e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:29.248827 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cedab646-91fc-4ce2-b08e-317ef7058c7e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:29.249244 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-cedab646-91fc-4ce2-b08e-317ef7058c7e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:29.383818 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-cedab646-91fc-4ce2-b08e-317ef7058c7e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:29.398130 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-cedab646-91fc-4ce2-b08e-317ef7058c7e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:29.399629 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-cedab646-91fc-4ce2-b08e-317ef7058c7e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:29.400799 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-cedab646-91fc-4ce2-b08e-317ef7058c7e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1724 microversion: 2.20 time: 0.165026 Aug 12 11:55:29.401338 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 398/786] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:29 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:30.426174 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-929fee83-c6c6-4681-853a-43f038d5f52e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:30.427428 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-929fee83-c6c6-4681-853a-43f038d5f52e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:30.436537 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-929fee83-c6c6-4681-853a-43f038d5f52e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:30.437924 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-929fee83-c6c6-4681-853a-43f038d5f52e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:30.438383 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-929fee83-c6c6-4681-853a-43f038d5f52e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:30.439322 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-929fee83-c6c6-4681-853a-43f038d5f52e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:30.439783 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-929fee83-c6c6-4681-853a-43f038d5f52e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:30.440210 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-929fee83-c6c6-4681-853a-43f038d5f52e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:30.584928 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-929fee83-c6c6-4681-853a-43f038d5f52e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:30.594797 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-929fee83-c6c6-4681-853a-43f038d5f52e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:30.596369 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-929fee83-c6c6-4681-853a-43f038d5f52e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:30.597544 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-929fee83-c6c6-4681-853a-43f038d5f52e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1745 microversion: 2.20 time: 0.177571 Aug 12 11:55:30.598228 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 389/787] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:30 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:55:30.711862 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-84e1ccd5-86ac-499a-bacd-2ace32e73d92 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:30.712348 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-84e1ccd5-86ac-499a-bacd-2ace32e73d92 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:30.718199 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-84e1ccd5-86ac-499a-bacd-2ace32e73d92 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:30.719267 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-84e1ccd5-86ac-499a-bacd-2ace32e73d92 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:30.719694 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-84e1ccd5-86ac-499a-bacd-2ace32e73d92 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:30.720366 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-84e1ccd5-86ac-499a-bacd-2ace32e73d92 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:30.720836 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-84e1ccd5-86ac-499a-bacd-2ace32e73d92 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:30.721248 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-84e1ccd5-86ac-499a-bacd-2ace32e73d92 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:30.744468 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-84e1ccd5-86ac-499a-bacd-2ace32e73d92 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e/ips" status: 200 len: 146 microversion: 2.1 time: 0.242662 Aug 12 11:55:30.744925 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 399/788] 10.222.0.42 () {58 vars in 1248 bytes} [Fri Aug 12 11:55:30 2022] GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e/ips => generated 146 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:55:31.621778 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-cb8854fe-af39-41e2-83c9-b7fcec015215 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:31.622435 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-cb8854fe-af39-41e2-83c9-b7fcec015215 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:31.631392 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cb8854fe-af39-41e2-83c9-b7fcec015215 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:31.631828 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cb8854fe-af39-41e2-83c9-b7fcec015215 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:31.632489 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cb8854fe-af39-41e2-83c9-b7fcec015215 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:31.633531 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cb8854fe-af39-41e2-83c9-b7fcec015215 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:31.633930 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cb8854fe-af39-41e2-83c9-b7fcec015215 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:31.634435 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cb8854fe-af39-41e2-83c9-b7fcec015215 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:31.798736 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-cb8854fe-af39-41e2-83c9-b7fcec015215 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:31.810362 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-cb8854fe-af39-41e2-83c9-b7fcec015215 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:31.812589 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-cb8854fe-af39-41e2-83c9-b7fcec015215 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:31.813759 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-cb8854fe-af39-41e2-83c9-b7fcec015215 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1740 microversion: 2.20 time: 0.196268 Aug 12 11:55:31.821218 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 390/789] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:31 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:32.091233 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-979099f7-9e02-4871-b76c-d92b303d9c07 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95fc2513-810e-4e41-bfa6-299f197b9980"}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:55:32.094118 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-979099f7-9e02-4871-b76c-d92b303d9c07 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:32.100854 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-979099f7-9e02-4871-b76c-d92b303d9c07 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:32.102943 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-979099f7-9e02-4871-b76c-d92b303d9c07 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:32.105013 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-979099f7-9e02-4871-b76c-d92b303d9c07 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:32.106838 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-979099f7-9e02-4871-b76c-d92b303d9c07 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:32.107311 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-979099f7-9e02-4871-b76c-d92b303d9c07 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:32.107908 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-979099f7-9e02-4871-b76c-d92b303d9c07 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:32.848659 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-9807a650-2f53-43d3-bf14-fe6b10d3541b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:32.849317 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-9807a650-2f53-43d3-bf14-fe6b10d3541b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:32.856592 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9807a650-2f53-43d3-bf14-fe6b10d3541b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:32.857074 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9807a650-2f53-43d3-bf14-fe6b10d3541b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:32.857509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9807a650-2f53-43d3-bf14-fe6b10d3541b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:32.858196 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9807a650-2f53-43d3-bf14-fe6b10d3541b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:32.858660 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9807a650-2f53-43d3-bf14-fe6b10d3541b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:32.859777 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9807a650-2f53-43d3-bf14-fe6b10d3541b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:33.006813 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-9807a650-2f53-43d3-bf14-fe6b10d3541b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:33.014834 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-9807a650-2f53-43d3-bf14-fe6b10d3541b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:33.017402 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-9807a650-2f53-43d3-bf14-fe6b10d3541b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:33.018855 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-9807a650-2f53-43d3-bf14-fe6b10d3541b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1740 microversion: 2.20 time: 0.177078 Aug 12 11:55:33.019778 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 391/790] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:32 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:55:34.041670 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-3914891f-aaae-44ed-afbf-4d7d8ea0f257 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:34.042933 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-3914891f-aaae-44ed-afbf-4d7d8ea0f257 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:34.050440 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3914891f-aaae-44ed-afbf-4d7d8ea0f257 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:34.050962 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3914891f-aaae-44ed-afbf-4d7d8ea0f257 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:34.051399 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3914891f-aaae-44ed-afbf-4d7d8ea0f257 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:34.052346 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3914891f-aaae-44ed-afbf-4d7d8ea0f257 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:34.052803 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3914891f-aaae-44ed-afbf-4d7d8ea0f257 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:34.053458 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3914891f-aaae-44ed-afbf-4d7d8ea0f257 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:34.195953 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-3914891f-aaae-44ed-afbf-4d7d8ea0f257 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:34.205734 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-3914891f-aaae-44ed-afbf-4d7d8ea0f257 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:34.207590 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-3914891f-aaae-44ed-afbf-4d7d8ea0f257 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:34.209218 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-3914891f-aaae-44ed-afbf-4d7d8ea0f257 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1740 microversion: 2.20 time: 0.171754 Aug 12 11:55:34.222632 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 392/791] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:34 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:55:34.924516 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:34.943835 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-979099f7-9e02-4871-b76c-d92b303d9c07 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "POST /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.859146 Aug 12 11:55:34.956219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 400/792] 10.222.0.42 () {60 vars in 1323 bytes} [Fri Aug 12 11:55:32 2022] POST /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e/os-volume_attachments => generated 194 bytes in 2873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:55:35.012166 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-196d883d-9424-46a7-a14f-42b3a62d3711 req-bca9483a-812b-4308-a6a2-bbf32c7335bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766f6d20-8985-4a72-b2d7-4062c001c834", "name": "network-vif-plugged", "status": "completed", "tag": "9f04531c-9036-4a8c-96e9-678608518051"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:55:35.023257 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-196d883d-9424-46a7-a14f-42b3a62d3711 req-bca9483a-812b-4308-a6a2-bbf32c7335bf service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:35.023939 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-196d883d-9424-46a7-a14f-42b3a62d3711 req-bca9483a-812b-4308-a6a2-bbf32c7335bf service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:35.024837 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-196d883d-9424-46a7-a14f-42b3a62d3711 req-bca9483a-812b-4308-a6a2-bbf32c7335bf service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:35.038466 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-196d883d-9424-46a7-a14f-42b3a62d3711 req-bca9483a-812b-4308-a6a2-bbf32c7335bf service nova] Creating event network-vif-plugged:9f04531c-9036-4a8c-96e9-678608518051 for instance 766f6d20-8985-4a72-b2d7-4062c001c834 on hv-cinder-85282 Aug 12 11:55:35.044796 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-196d883d-9424-46a7-a14f-42b3a62d3711 req-bca9483a-812b-4308-a6a2-bbf32c7335bf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176081 Aug 12 11:55:35.045639 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 393/793] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:55:35.233605 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-4c3e683e-4db2-4a58-b2fd-de6473a8326e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:35.235011 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-4c3e683e-4db2-4a58-b2fd-de6473a8326e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:35.246776 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4c3e683e-4db2-4a58-b2fd-de6473a8326e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:35.247707 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4c3e683e-4db2-4a58-b2fd-de6473a8326e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:35.248220 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4c3e683e-4db2-4a58-b2fd-de6473a8326e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:35.249152 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4c3e683e-4db2-4a58-b2fd-de6473a8326e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:35.249786 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4c3e683e-4db2-4a58-b2fd-de6473a8326e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:35.250281 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4c3e683e-4db2-4a58-b2fd-de6473a8326e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:35.399553 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-4c3e683e-4db2-4a58-b2fd-de6473a8326e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:35.408275 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-4c3e683e-4db2-4a58-b2fd-de6473a8326e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:35.410094 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-4c3e683e-4db2-4a58-b2fd-de6473a8326e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:35.411357 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-4c3e683e-4db2-4a58-b2fd-de6473a8326e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1740 microversion: 2.20 time: 0.182000 Aug 12 11:55:35.423042 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 401/794] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:35 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:36.437929 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e6c2061f-6286-4f21-980a-ef88cf91089b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:36.439560 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-e6c2061f-6286-4f21-980a-ef88cf91089b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:36.446911 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e6c2061f-6286-4f21-980a-ef88cf91089b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:36.447526 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e6c2061f-6286-4f21-980a-ef88cf91089b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:36.448194 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e6c2061f-6286-4f21-980a-ef88cf91089b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:36.449251 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e6c2061f-6286-4f21-980a-ef88cf91089b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:36.449911 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e6c2061f-6286-4f21-980a-ef88cf91089b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:36.450400 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e6c2061f-6286-4f21-980a-ef88cf91089b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:36.640090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e6c2061f-6286-4f21-980a-ef88cf91089b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:36.651000 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e6c2061f-6286-4f21-980a-ef88cf91089b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:36.653615 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e6c2061f-6286-4f21-980a-ef88cf91089b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:36.655730 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e6c2061f-6286-4f21-980a-ef88cf91089b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1740 microversion: 2.20 time: 0.222812 Aug 12 11:55:36.673779 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 394/795] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:36 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1740 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:37.681438 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-d0bc70d9-fd4e-4a24-a4d4-6c148f9ef4c8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:37.682141 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-d0bc70d9-fd4e-4a24-a4d4-6c148f9ef4c8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:37.688446 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d0bc70d9-fd4e-4a24-a4d4-6c148f9ef4c8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:37.689141 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d0bc70d9-fd4e-4a24-a4d4-6c148f9ef4c8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:37.689575 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d0bc70d9-fd4e-4a24-a4d4-6c148f9ef4c8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:37.690253 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d0bc70d9-fd4e-4a24-a4d4-6c148f9ef4c8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:37.690902 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d0bc70d9-fd4e-4a24-a4d4-6c148f9ef4c8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:37.691313 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d0bc70d9-fd4e-4a24-a4d4-6c148f9ef4c8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:37.847717 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-d0bc70d9-fd4e-4a24-a4d4-6c148f9ef4c8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:37.857350 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-d0bc70d9-fd4e-4a24-a4d4-6c148f9ef4c8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:37.859802 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-d0bc70d9-fd4e-4a24-a4d4-6c148f9ef4c8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:37.861108 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-d0bc70d9-fd4e-4a24-a4d4-6c148f9ef4c8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1740 microversion: 2.20 time: 0.184082 Aug 12 11:55:37.861827 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 402/796] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:37 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:38.894080 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-676e940b-a77b-451f-9b5d-630542c7888d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:38.894884 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-676e940b-a77b-451f-9b5d-630542c7888d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:38.901366 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-676e940b-a77b-451f-9b5d-630542c7888d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:38.901850 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-676e940b-a77b-451f-9b5d-630542c7888d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:38.912627 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-676e940b-a77b-451f-9b5d-630542c7888d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:38.913479 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-676e940b-a77b-451f-9b5d-630542c7888d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:38.913966 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-676e940b-a77b-451f-9b5d-630542c7888d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:38.914405 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-676e940b-a77b-451f-9b5d-630542c7888d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:39.087925 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-676e940b-a77b-451f-9b5d-630542c7888d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:39.096199 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-676e940b-a77b-451f-9b5d-630542c7888d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:39.098760 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-676e940b-a77b-451f-9b5d-630542c7888d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:39.100102 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-676e940b-a77b-451f-9b5d-630542c7888d tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1740 microversion: 2.20 time: 0.210760 Aug 12 11:55:39.118682 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 395/797] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:38 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:40.125790 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-6fe36fc3-a3e8-4578-848b-398fc0923727 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:40.127107 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-6fe36fc3-a3e8-4578-848b-398fc0923727 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:40.135581 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6fe36fc3-a3e8-4578-848b-398fc0923727 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:40.136406 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6fe36fc3-a3e8-4578-848b-398fc0923727 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:40.137398 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6fe36fc3-a3e8-4578-848b-398fc0923727 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:40.138547 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6fe36fc3-a3e8-4578-848b-398fc0923727 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:40.139261 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6fe36fc3-a3e8-4578-848b-398fc0923727 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:40.139951 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6fe36fc3-a3e8-4578-848b-398fc0923727 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:40.300711 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-6fe36fc3-a3e8-4578-848b-398fc0923727 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:40.309406 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-6fe36fc3-a3e8-4578-848b-398fc0923727 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:40.311539 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-6fe36fc3-a3e8-4578-848b-398fc0923727 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:40.313071 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-6fe36fc3-a3e8-4578-848b-398fc0923727 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1740 microversion: 2.20 time: 0.191704 Aug 12 11:55:40.313962 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 403/798] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:40 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:41.336396 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-94aeeaee-e709-423a-b695-86f1050a0713 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:41.337373 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-94aeeaee-e709-423a-b695-86f1050a0713 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:41.344613 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-94aeeaee-e709-423a-b695-86f1050a0713 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:41.345112 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-94aeeaee-e709-423a-b695-86f1050a0713 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:41.345521 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-94aeeaee-e709-423a-b695-86f1050a0713 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:41.346400 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-94aeeaee-e709-423a-b695-86f1050a0713 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:41.346873 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-94aeeaee-e709-423a-b695-86f1050a0713 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:41.347293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-94aeeaee-e709-423a-b695-86f1050a0713 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:41.487720 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-94aeeaee-e709-423a-b695-86f1050a0713 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:41.495500 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-94aeeaee-e709-423a-b695-86f1050a0713 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:41.497000 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-94aeeaee-e709-423a-b695-86f1050a0713 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:41.498162 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-94aeeaee-e709-423a-b695-86f1050a0713 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1722 microversion: 2.20 time: 0.165543 Aug 12 11:55:41.498725 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 396/799] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:41 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:42.524029 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-016da9da-7f83-4a65-a5c5-f88b3796f791 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:42.525423 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-016da9da-7f83-4a65-a5c5-f88b3796f791 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:42.534068 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-016da9da-7f83-4a65-a5c5-f88b3796f791 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:42.534803 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-016da9da-7f83-4a65-a5c5-f88b3796f791 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:42.535436 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-016da9da-7f83-4a65-a5c5-f88b3796f791 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:42.536321 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-016da9da-7f83-4a65-a5c5-f88b3796f791 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:42.537094 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-016da9da-7f83-4a65-a5c5-f88b3796f791 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:42.537682 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-016da9da-7f83-4a65-a5c5-f88b3796f791 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:42.590672 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-af6aa32e-91ec-4ddc-b589-b08835cccf2d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:42.593704 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-af6aa32e-91ec-4ddc-b589-b08835cccf2d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:42.602815 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-af6aa32e-91ec-4ddc-b589-b08835cccf2d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:42.606095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-af6aa32e-91ec-4ddc-b589-b08835cccf2d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:42.606860 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-af6aa32e-91ec-4ddc-b589-b08835cccf2d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:42.607812 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-af6aa32e-91ec-4ddc-b589-b08835cccf2d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:42.608442 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-af6aa32e-91ec-4ddc-b589-b08835cccf2d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:42.609068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-af6aa32e-91ec-4ddc-b589-b08835cccf2d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:42.646824 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-af6aa32e-91ec-4ddc-b589-b08835cccf2d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059959 Aug 12 11:55:42.647386 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 397/800] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Aug 12 11:55:42 2022] GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:55:42.660329 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-0d3472fa-1cf5-410e-a655-9f275c15b863 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:42.660834 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-0d3472fa-1cf5-410e-a655-9f275c15b863 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:42.666949 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0d3472fa-1cf5-410e-a655-9f275c15b863 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:42.667427 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0d3472fa-1cf5-410e-a655-9f275c15b863 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:42.667862 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0d3472fa-1cf5-410e-a655-9f275c15b863 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:42.668642 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0d3472fa-1cf5-410e-a655-9f275c15b863 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:42.669095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0d3472fa-1cf5-410e-a655-9f275c15b863 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:42.669518 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0d3472fa-1cf5-410e-a655-9f275c15b863 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:42.699072 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-016da9da-7f83-4a65-a5c5-f88b3796f791 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:42.700146 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-0d3472fa-1cf5-410e-a655-9f275c15b863 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e/os-volume_attachments/95fc2513-810e-4e41-bfa6-299f197b9980" status: 200 len: 194 microversion: 2.1 time: 0.044359 Aug 12 11:55:42.700753 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 398/801] 10.222.0.42 () {58 vars in 1413 bytes} [Fri Aug 12 11:55:42 2022] GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e/os-volume_attachments/95fc2513-810e-4e41-bfa6-299f197b9980 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:55:42.709817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-016da9da-7f83-4a65-a5c5-f88b3796f791 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:42.711359 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-016da9da-7f83-4a65-a5c5-f88b3796f791 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:42.712531 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-016da9da-7f83-4a65-a5c5-f88b3796f791 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1722 microversion: 2.20 time: 0.194325 Aug 12 11:55:42.713071 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 404/802] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:42 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:43.735768 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-047f8cd6-adef-4c02-9cf6-b424bd217def tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:43.736453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-047f8cd6-adef-4c02-9cf6-b424bd217def tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:43.742999 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-047f8cd6-adef-4c02-9cf6-b424bd217def tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:43.743603 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-047f8cd6-adef-4c02-9cf6-b424bd217def tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:43.744244 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-047f8cd6-adef-4c02-9cf6-b424bd217def tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:43.745061 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-047f8cd6-adef-4c02-9cf6-b424bd217def tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:43.745597 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-047f8cd6-adef-4c02-9cf6-b424bd217def tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:43.746098 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-047f8cd6-adef-4c02-9cf6-b424bd217def tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:43.879272 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-047f8cd6-adef-4c02-9cf6-b424bd217def tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:43.887206 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-047f8cd6-adef-4c02-9cf6-b424bd217def tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:43.888687 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-047f8cd6-adef-4c02-9cf6-b424bd217def tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:43.889819 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-047f8cd6-adef-4c02-9cf6-b424bd217def tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1722 microversion: 2.20 time: 0.158602 Aug 12 11:55:43.890368 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 399/803] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:43 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:44.031517 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-1cfb34bf-cd5c-46b3-b711-7cd055b39d38 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b2d12f5-5cd4-400a-bd71-da7f41baf9b4"}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:55:44.034090 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-1cfb34bf-cd5c-46b3-b711-7cd055b39d38 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:44.040155 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1cfb34bf-cd5c-46b3-b711-7cd055b39d38 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:44.040636 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1cfb34bf-cd5c-46b3-b711-7cd055b39d38 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:44.041070 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1cfb34bf-cd5c-46b3-b711-7cd055b39d38 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:44.041860 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1cfb34bf-cd5c-46b3-b711-7cd055b39d38 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:44.042342 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1cfb34bf-cd5c-46b3-b711-7cd055b39d38 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:44.042837 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1cfb34bf-cd5c-46b3-b711-7cd055b39d38 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:44.396929 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-1cfb34bf-cd5c-46b3-b711-7cd055b39d38 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "POST /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.369761 Aug 12 11:55:44.402697 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 405/804] 10.222.0.42 () {60 vars in 1323 bytes} [Fri Aug 12 11:55:44 2022] POST /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e/os-volume_attachments => generated 194 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:55:44.864309 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-3ae2e29f-6008-4cbb-8562-edc1544aae4f req-1aae3313-1952-4b1b-ac4d-43df02659ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766f6d20-8985-4a72-b2d7-4062c001c834", "name": "network-vif-unplugged", "status": "completed", "tag": "9f04531c-9036-4a8c-96e9-678608518051"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:55:44.875698 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-3ae2e29f-6008-4cbb-8562-edc1544aae4f req-1aae3313-1952-4b1b-ac4d-43df02659ee7 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:44.876350 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-3ae2e29f-6008-4cbb-8562-edc1544aae4f req-1aae3313-1952-4b1b-ac4d-43df02659ee7 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:44.877005 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-3ae2e29f-6008-4cbb-8562-edc1544aae4f req-1aae3313-1952-4b1b-ac4d-43df02659ee7 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:44.889176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.compute.server_external_events [req-3ae2e29f-6008-4cbb-8562-edc1544aae4f req-1aae3313-1952-4b1b-ac4d-43df02659ee7 service nova] Unable to find a host for instance 766f6d20-8985-4a72-b2d7-4062c001c834. Dropping event network-vif-unplugged {{(pid=132282) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 12 11:55:44.890579 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-3ae2e29f-6008-4cbb-8562-edc1544aae4f req-1aae3313-1952-4b1b-ac4d-43df02659ee7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029651 Aug 12 11:55:44.891200 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 400/805] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 12 11:55:44.914457 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-2bfae59b-a3bd-497e-8768-34b4a68ba7c1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:44.915181 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-2bfae59b-a3bd-497e-8768-34b4a68ba7c1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:44.921345 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2bfae59b-a3bd-497e-8768-34b4a68ba7c1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:44.921817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2bfae59b-a3bd-497e-8768-34b4a68ba7c1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:44.922245 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2bfae59b-a3bd-497e-8768-34b4a68ba7c1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:44.922994 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2bfae59b-a3bd-497e-8768-34b4a68ba7c1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:44.923438 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2bfae59b-a3bd-497e-8768-34b4a68ba7c1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:44.923850 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2bfae59b-a3bd-497e-8768-34b4a68ba7c1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:45.052757 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-2bfae59b-a3bd-497e-8768-34b4a68ba7c1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:45.060619 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-2bfae59b-a3bd-497e-8768-34b4a68ba7c1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:45.063011 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-2bfae59b-a3bd-497e-8768-34b4a68ba7c1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:45.064140 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-2bfae59b-a3bd-497e-8768-34b4a68ba7c1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1665 microversion: 2.20 time: 0.154574 Aug 12 11:55:45.064857 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 406/806] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:44 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1665 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:45.085619 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-940dfe98-d57a-454f-a653-8e02b3f80ce6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6ff23fb-4676-4508-b777-545617365adf"}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:55:45.087966 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-940dfe98-d57a-454f-a653-8e02b3f80ce6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:45.093726 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-940dfe98-d57a-454f-a653-8e02b3f80ce6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:45.094198 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-940dfe98-d57a-454f-a653-8e02b3f80ce6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:45.094684 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-940dfe98-d57a-454f-a653-8e02b3f80ce6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:45.095374 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-940dfe98-d57a-454f-a653-8e02b3f80ce6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:45.095820 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-940dfe98-d57a-454f-a653-8e02b3f80ce6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:45.096242 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-940dfe98-d57a-454f-a653-8e02b3f80ce6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:45.353695 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-940dfe98-d57a-454f-a653-8e02b3f80ce6 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "POST /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.271895 Aug 12 11:55:45.354334 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 401/807] 10.222.0.42 () {62 vars in 1364 bytes} [Fri Aug 12 11:55:45 2022] POST /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834/os-volume_attachments => generated 188 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 12 11:55:45.478645 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-c1282ccd-4792-4462-8bfc-90ebf56cf0c1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:45.479214 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-c1282ccd-4792-4462-8bfc-90ebf56cf0c1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:45.481711 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_api:SELECT=40 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:45.487867 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c1282ccd-4792-4462-8bfc-90ebf56cf0c1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:45.488425 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c1282ccd-4792-4462-8bfc-90ebf56cf0c1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:45.488926 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c1282ccd-4792-4462-8bfc-90ebf56cf0c1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:45.489683 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c1282ccd-4792-4462-8bfc-90ebf56cf0c1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:45.490203 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c1282ccd-4792-4462-8bfc-90ebf56cf0c1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:45.490644 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c1282ccd-4792-4462-8bfc-90ebf56cf0c1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:45.742618 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-c1282ccd-4792-4462-8bfc-90ebf56cf0c1 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "DELETE /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834/os-volume_attachments/e6ff23fb-4676-4508-b777-545617365adf" status: 202 len: 0 microversion: 2.20 time: 0.268056 Aug 12 11:55:45.743405 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 407/808] 10.222.0.42 () {60 vars in 1457 bytes} [Fri Aug 12 11:55:45 2022] DELETE /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834/os-volume_attachments/e6ff23fb-4676-4508-b777-545617365adf => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 12 11:55:45.803597 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-419a1330-2253-4550-840c-f4511479b072 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:55:45.804368 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-419a1330-2253-4550-840c-f4511479b072 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:45.810251 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-419a1330-2253-4550-840c-f4511479b072 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:45.810765 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-419a1330-2253-4550-840c-f4511479b072 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:45.811446 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-419a1330-2253-4550-840c-f4511479b072 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:45.812748 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-419a1330-2253-4550-840c-f4511479b072 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:45.813197 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-419a1330-2253-4550-840c-f4511479b072 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:45.813613 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-419a1330-2253-4550-840c-f4511479b072 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:45.830346 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:45.976778 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-419a1330-2253-4550-840c-f4511479b072 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132282) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 12 11:55:46.051957 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-419a1330-2253-4550-840c-f4511479b072 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "POST /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834/action" status: 202 len: 0 microversion: 2.20 time: 0.252138 Aug 12 11:55:46.052568 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 402/809] 10.222.0.42 () {62 vars in 1319 bytes} [Fri Aug 12 11:55:45 2022] POST /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 12 11:55:46.060630 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-314f4823-5a90-4ee4-b8be-74182bd9bc4b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:46.061499 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-314f4823-5a90-4ee4-b8be-74182bd9bc4b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:46.069238 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-314f4823-5a90-4ee4-b8be-74182bd9bc4b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:46.069720 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-314f4823-5a90-4ee4-b8be-74182bd9bc4b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:46.070154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-314f4823-5a90-4ee4-b8be-74182bd9bc4b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:46.070880 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-314f4823-5a90-4ee4-b8be-74182bd9bc4b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:46.071325 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-314f4823-5a90-4ee4-b8be-74182bd9bc4b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:46.071742 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-314f4823-5a90-4ee4-b8be-74182bd9bc4b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:46.216293 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-314f4823-5a90-4ee4-b8be-74182bd9bc4b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:46.224658 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-314f4823-5a90-4ee4-b8be-74182bd9bc4b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:46.226142 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-314f4823-5a90-4ee4-b8be-74182bd9bc4b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:46.227327 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-314f4823-5a90-4ee4-b8be-74182bd9bc4b tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1673 microversion: 2.20 time: 0.170607 Aug 12 11:55:46.227870 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 408/810] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:46 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:47.249068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-331bed14-8c95-4c01-a9bb-09cda9d81a70 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:47.250218 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-331bed14-8c95-4c01-a9bb-09cda9d81a70 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:47.257748 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-331bed14-8c95-4c01-a9bb-09cda9d81a70 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:47.258231 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-331bed14-8c95-4c01-a9bb-09cda9d81a70 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:47.258683 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-331bed14-8c95-4c01-a9bb-09cda9d81a70 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:47.259379 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-331bed14-8c95-4c01-a9bb-09cda9d81a70 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:47.259823 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-331bed14-8c95-4c01-a9bb-09cda9d81a70 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:47.260508 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-331bed14-8c95-4c01-a9bb-09cda9d81a70 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:47.407947 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-331bed14-8c95-4c01-a9bb-09cda9d81a70 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:47.415749 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-331bed14-8c95-4c01-a9bb-09cda9d81a70 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:47.417226 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-331bed14-8c95-4c01-a9bb-09cda9d81a70 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:47.418369 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-331bed14-8c95-4c01-a9bb-09cda9d81a70 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1675 microversion: 2.20 time: 0.173233 Aug 12 11:55:47.418940 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 403/811] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:47 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:48.444815 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-15c024bc-9246-4995-9b54-a7d4f2fd8900 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:48.445497 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-15c024bc-9246-4995-9b54-a7d4f2fd8900 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:48.454285 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-15c024bc-9246-4995-9b54-a7d4f2fd8900 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:48.455125 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-15c024bc-9246-4995-9b54-a7d4f2fd8900 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:48.455556 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-15c024bc-9246-4995-9b54-a7d4f2fd8900 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:48.457091 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-15c024bc-9246-4995-9b54-a7d4f2fd8900 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:48.457711 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-15c024bc-9246-4995-9b54-a7d4f2fd8900 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:48.458127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-15c024bc-9246-4995-9b54-a7d4f2fd8900 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:48.762310 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-15c024bc-9246-4995-9b54-a7d4f2fd8900 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:48.772197 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-15c024bc-9246-4995-9b54-a7d4f2fd8900 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:48.774383 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-15c024bc-9246-4995-9b54-a7d4f2fd8900 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:48.776216 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-15c024bc-9246-4995-9b54-a7d4f2fd8900 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1731 microversion: 2.20 time: 0.337838 Aug 12 11:55:48.788535 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 409/812] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:48 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1731 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:49.801062 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-149c6a84-59db-45bb-a61a-166fe5c94fcd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:49.802460 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-149c6a84-59db-45bb-a61a-166fe5c94fcd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:49.808966 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-149c6a84-59db-45bb-a61a-166fe5c94fcd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:49.809705 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-149c6a84-59db-45bb-a61a-166fe5c94fcd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:49.810308 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-149c6a84-59db-45bb-a61a-166fe5c94fcd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:49.811614 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-149c6a84-59db-45bb-a61a-166fe5c94fcd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:49.812903 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-149c6a84-59db-45bb-a61a-166fe5c94fcd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:49.813500 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-149c6a84-59db-45bb-a61a-166fe5c94fcd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:50.004980 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-149c6a84-59db-45bb-a61a-166fe5c94fcd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:50.013413 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-149c6a84-59db-45bb-a61a-166fe5c94fcd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:50.019787 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-149c6a84-59db-45bb-a61a-166fe5c94fcd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:50.021192 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-149c6a84-59db-45bb-a61a-166fe5c94fcd tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1731 microversion: 2.20 time: 0.225347 Aug 12 11:55:50.021777 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 404/813] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:49 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1731 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:51.045601 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-61dbb61e-d71d-4c30-b473-739fd5105c63 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:51.046881 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-61dbb61e-d71d-4c30-b473-739fd5105c63 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:51.054556 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-61dbb61e-d71d-4c30-b473-739fd5105c63 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:51.055050 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-61dbb61e-d71d-4c30-b473-739fd5105c63 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:51.055575 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-61dbb61e-d71d-4c30-b473-739fd5105c63 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:51.056272 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-61dbb61e-d71d-4c30-b473-739fd5105c63 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:51.056981 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-61dbb61e-d71d-4c30-b473-739fd5105c63 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:51.057396 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-61dbb61e-d71d-4c30-b473-739fd5105c63 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:51.238575 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-61dbb61e-d71d-4c30-b473-739fd5105c63 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:51.251114 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-61dbb61e-d71d-4c30-b473-739fd5105c63 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:51.253983 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-61dbb61e-d71d-4c30-b473-739fd5105c63 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:51.255388 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-61dbb61e-d71d-4c30-b473-739fd5105c63 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1731 microversion: 2.20 time: 0.214142 Aug 12 11:55:51.255940 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 410/814] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:51 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1731 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:52.277370 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e8e36236-fb26-4ac3-8b5e-162862b580af tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:52.277896 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-e8e36236-fb26-4ac3-8b5e-162862b580af tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:52.284342 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e8e36236-fb26-4ac3-8b5e-162862b580af tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:52.284834 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e8e36236-fb26-4ac3-8b5e-162862b580af tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:52.285271 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e8e36236-fb26-4ac3-8b5e-162862b580af tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:52.285964 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e8e36236-fb26-4ac3-8b5e-162862b580af tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:52.286416 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e8e36236-fb26-4ac3-8b5e-162862b580af tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:52.286870 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e8e36236-fb26-4ac3-8b5e-162862b580af tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:52.442204 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e8e36236-fb26-4ac3-8b5e-162862b580af tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:52.451253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e8e36236-fb26-4ac3-8b5e-162862b580af tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:52.452965 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e8e36236-fb26-4ac3-8b5e-162862b580af tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:52.454215 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e8e36236-fb26-4ac3-8b5e-162862b580af tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1731 microversion: 2.20 time: 0.180830 Aug 12 11:55:52.454976 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 405/815] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:52 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:53.478557 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-abad1323-73ea-4d37-868c-7930b34dd61f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:53.479207 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-abad1323-73ea-4d37-868c-7930b34dd61f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:53.491421 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-abad1323-73ea-4d37-868c-7930b34dd61f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:53.491931 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-abad1323-73ea-4d37-868c-7930b34dd61f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:53.493246 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-abad1323-73ea-4d37-868c-7930b34dd61f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:53.493970 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-abad1323-73ea-4d37-868c-7930b34dd61f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:53.494425 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-abad1323-73ea-4d37-868c-7930b34dd61f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:53.500414 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-abad1323-73ea-4d37-868c-7930b34dd61f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:53.684051 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-abad1323-73ea-4d37-868c-7930b34dd61f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:53.692862 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-abad1323-73ea-4d37-868c-7930b34dd61f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:53.694364 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-abad1323-73ea-4d37-868c-7930b34dd61f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:53.695666 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-abad1323-73ea-4d37-868c-7930b34dd61f tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1731 microversion: 2.20 time: 0.222533 Aug 12 11:55:53.696218 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 411/816] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:53 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1731 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:54.731742 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-f9a98dfb-89e5-4e9e-9948-6b163414a8ce tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:54.733010 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-f9a98dfb-89e5-4e9e-9948-6b163414a8ce tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:54.740780 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:54.743183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f9a98dfb-89e5-4e9e-9948-6b163414a8ce tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:54.744462 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f9a98dfb-89e5-4e9e-9948-6b163414a8ce tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:54.746021 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f9a98dfb-89e5-4e9e-9948-6b163414a8ce tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:54.747282 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f9a98dfb-89e5-4e9e-9948-6b163414a8ce tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:54.748023 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f9a98dfb-89e5-4e9e-9948-6b163414a8ce tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:54.749143 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f9a98dfb-89e5-4e9e-9948-6b163414a8ce tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:54.901635 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-f9a98dfb-89e5-4e9e-9948-6b163414a8ce tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:54.910298 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-f9a98dfb-89e5-4e9e-9948-6b163414a8ce tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:54.911856 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-f9a98dfb-89e5-4e9e-9948-6b163414a8ce tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:54.913002 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-f9a98dfb-89e5-4e9e-9948-6b163414a8ce tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1731 microversion: 2.20 time: 0.197613 Aug 12 11:55:54.913548 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 406/817] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:54 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1731 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:55:55.372738 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-b2bd7cc2-fd31-4520-a66c-a8544869f7bd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:55.373270 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-b2bd7cc2-fd31-4520-a66c-a8544869f7bd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:55.380219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b2bd7cc2-fd31-4520-a66c-a8544869f7bd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:55.380696 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b2bd7cc2-fd31-4520-a66c-a8544869f7bd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:55.381125 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b2bd7cc2-fd31-4520-a66c-a8544869f7bd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:55.381808 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b2bd7cc2-fd31-4520-a66c-a8544869f7bd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:55.382255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b2bd7cc2-fd31-4520-a66c-a8544869f7bd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:55.382698 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b2bd7cc2-fd31-4520-a66c-a8544869f7bd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:55.407088 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-b2bd7cc2-fd31-4520-a66c-a8544869f7bd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8/ips" status: 200 len: 150 microversion: 2.1 time: 0.038181 Aug 12 11:55:55.408134 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 412/818] 10.222.0.42 () {58 vars in 1248 bytes} [Fri Aug 12 11:55:55 2022] GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:55:55.937561 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-521ad657-54ec-47a6-a909-5c28b9031d9e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:55.938194 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-521ad657-54ec-47a6-a909-5c28b9031d9e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:55.949756 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-521ad657-54ec-47a6-a909-5c28b9031d9e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:55.950691 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-521ad657-54ec-47a6-a909-5c28b9031d9e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:55.951325 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-521ad657-54ec-47a6-a909-5c28b9031d9e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:55.952297 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-521ad657-54ec-47a6-a909-5c28b9031d9e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:55.953572 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-521ad657-54ec-47a6-a909-5c28b9031d9e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:55.954190 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-521ad657-54ec-47a6-a909-5c28b9031d9e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:56.104266 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-521ad657-54ec-47a6-a909-5c28b9031d9e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:56.114093 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-521ad657-54ec-47a6-a909-5c28b9031d9e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:56.115904 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-521ad657-54ec-47a6-a909-5c28b9031d9e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:56.117627 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-521ad657-54ec-47a6-a909-5c28b9031d9e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1731 microversion: 2.20 time: 0.185728 Aug 12 11:55:56.140391 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 407/819] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:55 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1731 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:55:56.788276 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-82f4743d-f615-418f-b583-2ddca3f5eb11 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a08c99ae-9d28-4c7d-bd78-b7fffb162465"}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:55:56.790698 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-82f4743d-f615-418f-b583-2ddca3f5eb11 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:56.798085 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-82f4743d-f615-418f-b583-2ddca3f5eb11 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:56.798913 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-82f4743d-f615-418f-b583-2ddca3f5eb11 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:56.799372 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-82f4743d-f615-418f-b583-2ddca3f5eb11 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:56.800248 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-82f4743d-f615-418f-b583-2ddca3f5eb11 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:56.800695 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-82f4743d-f615-418f-b583-2ddca3f5eb11 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:56.801255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-82f4743d-f615-418f-b583-2ddca3f5eb11 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:57.147482 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-4d326931-44dc-47cd-861d-f9b8ebf83d5e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:57.148088 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-4d326931-44dc-47cd-861d-f9b8ebf83d5e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:57.154330 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4d326931-44dc-47cd-861d-f9b8ebf83d5e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:57.154836 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4d326931-44dc-47cd-861d-f9b8ebf83d5e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:57.156033 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4d326931-44dc-47cd-861d-f9b8ebf83d5e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:57.156720 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4d326931-44dc-47cd-861d-f9b8ebf83d5e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:57.157166 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4d326931-44dc-47cd-861d-f9b8ebf83d5e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:57.157727 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4d326931-44dc-47cd-861d-f9b8ebf83d5e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:57.334182 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-4d326931-44dc-47cd-861d-f9b8ebf83d5e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:57.342377 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-4d326931-44dc-47cd-861d-f9b8ebf83d5e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:57.344133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-4d326931-44dc-47cd-861d-f9b8ebf83d5e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:57.345133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-4d326931-44dc-47cd-861d-f9b8ebf83d5e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1731 microversion: 2.20 time: 0.201524 Aug 12 11:55:57.345683 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 408/820] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:57 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1731 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:55:58.367564 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-82d8f323-b8fa-4972-a358-778bb4d13193 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:58.368173 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-82d8f323-b8fa-4972-a358-778bb4d13193 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:58.375242 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-82d8f323-b8fa-4972-a358-778bb4d13193 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:58.375725 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-82d8f323-b8fa-4972-a358-778bb4d13193 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:58.376155 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-82d8f323-b8fa-4972-a358-778bb4d13193 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:58.376844 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-82d8f323-b8fa-4972-a358-778bb4d13193 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:58.377290 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-82d8f323-b8fa-4972-a358-778bb4d13193 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:58.377709 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-82d8f323-b8fa-4972-a358-778bb4d13193 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:58.423256 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:58.583326 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-82f4743d-f615-418f-b583-2ddca3f5eb11 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "POST /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.798764 Aug 12 11:55:58.584433 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 413/821] 10.222.0.42 () {60 vars in 1323 bytes} [Fri Aug 12 11:55:56 2022] POST /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8/os-volume_attachments => generated 194 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:55:58.697716 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-82d8f323-b8fa-4972-a358-778bb4d13193 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:58.708156 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-82d8f323-b8fa-4972-a358-778bb4d13193 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:58.717446 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-82d8f323-b8fa-4972-a358-778bb4d13193 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:58.718799 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-82d8f323-b8fa-4972-a358-778bb4d13193 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1731 microversion: 2.20 time: 0.354828 Aug 12 11:55:58.719531 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 409/822] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:58 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1731 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:55:59.741988 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-197ee179-1ce4-480d-88c9-66e654229082 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:55:59.742725 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-197ee179-1ce4-480d-88c9-66e654229082 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:55:59.748717 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-197ee179-1ce4-480d-88c9-66e654229082 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:59.749203 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-197ee179-1ce4-480d-88c9-66e654229082 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:59.749636 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-197ee179-1ce4-480d-88c9-66e654229082 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:59.750321 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-197ee179-1ce4-480d-88c9-66e654229082 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:55:59.750803 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-197ee179-1ce4-480d-88c9-66e654229082 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:55:59.751223 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-197ee179-1ce4-480d-88c9-66e654229082 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:55:59.877690 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-197ee179-1ce4-480d-88c9-66e654229082 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:59.885486 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-197ee179-1ce4-480d-88c9-66e654229082 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:59.887003 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-197ee179-1ce4-480d-88c9-66e654229082 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:55:59.888146 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-197ee179-1ce4-480d-88c9-66e654229082 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1731 microversion: 2.20 time: 0.150859 Aug 12 11:55:59.888690 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 414/823] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:55:59 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:56:00.911210 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-bb628916-2127-4964-9fec-4e0ef5f444e8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:00.911815 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-bb628916-2127-4964-9fec-4e0ef5f444e8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:00.918264 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bb628916-2127-4964-9fec-4e0ef5f444e8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:00.918783 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bb628916-2127-4964-9fec-4e0ef5f444e8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:00.919222 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bb628916-2127-4964-9fec-4e0ef5f444e8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:00.919910 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bb628916-2127-4964-9fec-4e0ef5f444e8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:00.920363 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bb628916-2127-4964-9fec-4e0ef5f444e8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:00.920784 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bb628916-2127-4964-9fec-4e0ef5f444e8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:01.048368 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-bb628916-2127-4964-9fec-4e0ef5f444e8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:01.056155 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-bb628916-2127-4964-9fec-4e0ef5f444e8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:01.057646 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-bb628916-2127-4964-9fec-4e0ef5f444e8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:01.058826 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-bb628916-2127-4964-9fec-4e0ef5f444e8 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1731 microversion: 2.20 time: 0.151503 Aug 12 11:56:01.059362 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 410/824] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:56:00 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:56:02.081796 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-8743b69c-a16a-4ebe-846e-d25ad2d46b36 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:02.082353 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-8743b69c-a16a-4ebe-846e-d25ad2d46b36 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:02.088971 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8743b69c-a16a-4ebe-846e-d25ad2d46b36 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:02.089443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8743b69c-a16a-4ebe-846e-d25ad2d46b36 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:02.089869 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8743b69c-a16a-4ebe-846e-d25ad2d46b36 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:02.090545 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8743b69c-a16a-4ebe-846e-d25ad2d46b36 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:02.091016 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8743b69c-a16a-4ebe-846e-d25ad2d46b36 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:02.091435 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8743b69c-a16a-4ebe-846e-d25ad2d46b36 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:02.223369 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-8743b69c-a16a-4ebe-846e-d25ad2d46b36 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:02.231242 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-8743b69c-a16a-4ebe-846e-d25ad2d46b36 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:02.232724 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-8743b69c-a16a-4ebe-846e-d25ad2d46b36 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:02.233868 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-8743b69c-a16a-4ebe-846e-d25ad2d46b36 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1731 microversion: 2.20 time: 0.156563 Aug 12 11:56:02.234408 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 415/825] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:56:02 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:56:03.122387 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-0a17edd7-a7db-4d24-bbd1-0e8e9bae8308 req-0e716bb3-faf3-4b15-a903-8ed27c58f876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766f6d20-8985-4a72-b2d7-4062c001c834", "name": "network-vif-plugged", "status": "completed", "tag": "9f04531c-9036-4a8c-96e9-678608518051"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:56:03.137495 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-0a17edd7-a7db-4d24-bbd1-0e8e9bae8308 req-0e716bb3-faf3-4b15-a903-8ed27c58f876 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:03.138112 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-0a17edd7-a7db-4d24-bbd1-0e8e9bae8308 req-0e716bb3-faf3-4b15-a903-8ed27c58f876 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:03.138827 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-0a17edd7-a7db-4d24-bbd1-0e8e9bae8308 req-0e716bb3-faf3-4b15-a903-8ed27c58f876 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:03.156918 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-0a17edd7-a7db-4d24-bbd1-0e8e9bae8308 req-0e716bb3-faf3-4b15-a903-8ed27c58f876 service nova] Creating event network-vif-plugged:9f04531c-9036-4a8c-96e9-678608518051 for instance 766f6d20-8985-4a72-b2d7-4062c001c834 on hv-cinder-85282 Aug 12 11:56:03.159896 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-0a17edd7-a7db-4d24-bbd1-0e8e9bae8308 req-0e716bb3-faf3-4b15-a903-8ed27c58f876 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042172 Aug 12 11:56:03.160680 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 411/826] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:56:03.256160 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-841c090e-4172-4f46-ab29-40a93520d57e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:03.256780 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-841c090e-4172-4f46-ab29-40a93520d57e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:03.263235 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-841c090e-4172-4f46-ab29-40a93520d57e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:03.263742 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-841c090e-4172-4f46-ab29-40a93520d57e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:03.264180 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-841c090e-4172-4f46-ab29-40a93520d57e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:03.265461 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-841c090e-4172-4f46-ab29-40a93520d57e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:03.265922 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-841c090e-4172-4f46-ab29-40a93520d57e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:03.266347 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-841c090e-4172-4f46-ab29-40a93520d57e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:03.431634 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-841c090e-4172-4f46-ab29-40a93520d57e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:03.442561 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-841c090e-4172-4f46-ab29-40a93520d57e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:03.444048 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-841c090e-4172-4f46-ab29-40a93520d57e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:03.445211 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-841c090e-4172-4f46-ab29-40a93520d57e tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1731 microversion: 2.20 time: 0.193004 Aug 12 11:56:03.445758 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 416/827] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:56:03 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:56:03.750817 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e74fe286-dcba-41b3-ab2a-6f7dba5d3449 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:03.753107 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-e74fe286-dcba-41b3-ab2a-6f7dba5d3449 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:03.759125 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e74fe286-dcba-41b3-ab2a-6f7dba5d3449 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:03.759602 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e74fe286-dcba-41b3-ab2a-6f7dba5d3449 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:03.760035 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e74fe286-dcba-41b3-ab2a-6f7dba5d3449 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:03.760714 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e74fe286-dcba-41b3-ab2a-6f7dba5d3449 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:03.761164 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e74fe286-dcba-41b3-ab2a-6f7dba5d3449 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:03.761619 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e74fe286-dcba-41b3-ab2a-6f7dba5d3449 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:03.789836 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e74fe286-dcba-41b3-ab2a-6f7dba5d3449 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044014 Aug 12 11:56:03.790363 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 412/828] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Aug 12 11:56:03 2022] GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:56:03.943458 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-dedbab37-ac69-40e2-99ea-78f25a0dae2e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:03.943990 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-dedbab37-ac69-40e2-99ea-78f25a0dae2e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:03.950194 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dedbab37-ac69-40e2-99ea-78f25a0dae2e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:03.950720 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dedbab37-ac69-40e2-99ea-78f25a0dae2e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:03.951154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dedbab37-ac69-40e2-99ea-78f25a0dae2e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:03.951849 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dedbab37-ac69-40e2-99ea-78f25a0dae2e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:03.952303 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dedbab37-ac69-40e2-99ea-78f25a0dae2e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:03.952718 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dedbab37-ac69-40e2-99ea-78f25a0dae2e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:03.986736 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-dedbab37-ac69-40e2-99ea-78f25a0dae2e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e/os-volume_attachments/95fc2513-810e-4e41-bfa6-299f197b9980" status: 200 len: 194 microversion: 2.1 time: 0.047101 Aug 12 11:56:03.987351 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 417/829] 10.222.0.42 () {58 vars in 1413 bytes} [Fri Aug 12 11:56:03 2022] GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e/os-volume_attachments/95fc2513-810e-4e41-bfa6-299f197b9980 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:56:03.998126 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-505dd10e-75d9-40b6-ae0f-1919281af97f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:03.998630 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-505dd10e-75d9-40b6-ae0f-1919281af97f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:04.004857 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-505dd10e-75d9-40b6-ae0f-1919281af97f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:04.005502 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-505dd10e-75d9-40b6-ae0f-1919281af97f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:04.005941 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-505dd10e-75d9-40b6-ae0f-1919281af97f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:04.006803 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-505dd10e-75d9-40b6-ae0f-1919281af97f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:04.007267 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-505dd10e-75d9-40b6-ae0f-1919281af97f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:04.007688 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-505dd10e-75d9-40b6-ae0f-1919281af97f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:04.094054 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.objects.instance [None req-505dd10e-75d9-40b6-ae0f-1919281af97f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lazy-loading 'services' on Instance uuid ddc60294-41d7-4e33-8cca-92dc40f56d6e {{(pid=132282) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:56:04.169117 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-505dd10e-75d9-40b6-ae0f-1919281af97f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e/os-volume_attachments/95fc2513-810e-4e41-bfa6-299f197b9980" status: 202 len: 0 microversion: 2.1 time: 0.174910 Aug 12 11:56:04.169770 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 413/830] 10.222.0.42 () {58 vars in 1416 bytes} [Fri Aug 12 11:56:03 2022] DELETE /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e/os-volume_attachments/95fc2513-810e-4e41-bfa6-299f197b9980 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:56:04.468186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-77bbe1dd-0304-475e-9058-7517162ca031 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:04.468787 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-77bbe1dd-0304-475e-9058-7517162ca031 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:04.474745 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-77bbe1dd-0304-475e-9058-7517162ca031 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:04.475297 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-77bbe1dd-0304-475e-9058-7517162ca031 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:04.475728 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-77bbe1dd-0304-475e-9058-7517162ca031 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:04.476408 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-77bbe1dd-0304-475e-9058-7517162ca031 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:04.476854 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-77bbe1dd-0304-475e-9058-7517162ca031 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:04.477272 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-77bbe1dd-0304-475e-9058-7517162ca031 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:04.609463 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-77bbe1dd-0304-475e-9058-7517162ca031 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:04.618097 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-77bbe1dd-0304-475e-9058-7517162ca031 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:04.619732 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-77bbe1dd-0304-475e-9058-7517162ca031 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:04.620897 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-77bbe1dd-0304-475e-9058-7517162ca031 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1731 microversion: 2.20 time: 0.156549 Aug 12 11:56:04.621812 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 418/831] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:56:04 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:56:05.646749 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-db86b9ef-e0aa-4075-b893-6f0589ebf4e5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:05.647444 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-db86b9ef-e0aa-4075-b893-6f0589ebf4e5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:05.653576 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-db86b9ef-e0aa-4075-b893-6f0589ebf4e5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:05.654049 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-db86b9ef-e0aa-4075-b893-6f0589ebf4e5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:05.654478 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-db86b9ef-e0aa-4075-b893-6f0589ebf4e5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:05.655194 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-db86b9ef-e0aa-4075-b893-6f0589ebf4e5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:05.655643 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-db86b9ef-e0aa-4075-b893-6f0589ebf4e5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:05.656061 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-db86b9ef-e0aa-4075-b893-6f0589ebf4e5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:05.812422 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-db86b9ef-e0aa-4075-b893-6f0589ebf4e5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:05.822010 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-db86b9ef-e0aa-4075-b893-6f0589ebf4e5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:05.826897 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-db86b9ef-e0aa-4075-b893-6f0589ebf4e5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:05.828747 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-db86b9ef-e0aa-4075-b893-6f0589ebf4e5 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1731 microversion: 2.20 time: 0.186742 Aug 12 11:56:05.829542 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 414/832] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:56:05 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:56:06.851929 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-be1f0988-adb5-4c96-85ca-1b77b1abf185 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:06.852532 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-be1f0988-adb5-4c96-85ca-1b77b1abf185 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:06.861119 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-be1f0988-adb5-4c96-85ca-1b77b1abf185 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:06.861119 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-be1f0988-adb5-4c96-85ca-1b77b1abf185 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:06.861119 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-be1f0988-adb5-4c96-85ca-1b77b1abf185 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:06.861119 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-be1f0988-adb5-4c96-85ca-1b77b1abf185 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:06.861451 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-be1f0988-adb5-4c96-85ca-1b77b1abf185 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:06.864279 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-be1f0988-adb5-4c96-85ca-1b77b1abf185 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:06.993161 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-be1f0988-adb5-4c96-85ca-1b77b1abf185 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:07.001702 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-be1f0988-adb5-4c96-85ca-1b77b1abf185 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:07.003291 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-be1f0988-adb5-4c96-85ca-1b77b1abf185 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:07.004782 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-be1f0988-adb5-4c96-85ca-1b77b1abf185 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1718 microversion: 2.20 time: 0.156706 Aug 12 11:56:07.005406 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 419/833] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:56:06 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:56:10.492194 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-1f5a030d-5780-41db-806e-98b4672b0a68 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:10.492789 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-1f5a030d-5780-41db-806e-98b4672b0a68 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:10.501420 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1f5a030d-5780-41db-806e-98b4672b0a68 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:10.501920 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1f5a030d-5780-41db-806e-98b4672b0a68 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:10.502345 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1f5a030d-5780-41db-806e-98b4672b0a68 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:10.503533 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1f5a030d-5780-41db-806e-98b4672b0a68 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:10.504073 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1f5a030d-5780-41db-806e-98b4672b0a68 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:10.504629 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1f5a030d-5780-41db-806e-98b4672b0a68 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:10.580259 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-66828999-153f-4944-9308-b9397587816d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:10.580778 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-66828999-153f-4944-9308-b9397587816d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:10.587350 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-66828999-153f-4944-9308-b9397587816d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:10.587823 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-66828999-153f-4944-9308-b9397587816d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:10.588251 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-66828999-153f-4944-9308-b9397587816d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:10.588942 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-66828999-153f-4944-9308-b9397587816d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:10.589371 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-66828999-153f-4944-9308-b9397587816d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:10.589787 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-66828999-153f-4944-9308-b9397587816d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:10.600674 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.objects.instance [None req-1f5a030d-5780-41db-806e-98b4672b0a68 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lazy-loading 'services' on Instance uuid 15bed11d-dd0b-4cc8-ab40-968fdf8689c8 {{(pid=132282) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:56:10.620370 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-66828999-153f-4944-9308-b9397587816d tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e/os-volume_attachments/3b2d12f5-5cd4-400a-bd71-da7f41baf9b4" status: 200 len: 194 microversion: 2.1 time: 0.044710 Aug 12 11:56:10.620952 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 420/834] 10.222.0.42 () {58 vars in 1413 bytes} [Fri Aug 12 11:56:10 2022] GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e/os-volume_attachments/3b2d12f5-5cd4-400a-bd71-da7f41baf9b4 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:56:10.632219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-624e77f9-94b4-485c-af1c-491c4812536f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:10.632938 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-624e77f9-94b4-485c-af1c-491c4812536f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:10.639332 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-624e77f9-94b4-485c-af1c-491c4812536f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:10.639822 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-624e77f9-94b4-485c-af1c-491c4812536f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:10.640283 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-624e77f9-94b4-485c-af1c-491c4812536f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:10.641579 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-624e77f9-94b4-485c-af1c-491c4812536f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:10.642038 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-624e77f9-94b4-485c-af1c-491c4812536f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:10.642463 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-624e77f9-94b4-485c-af1c-491c4812536f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:10.683624 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-1f5a030d-5780-41db-806e-98b4672b0a68 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "DELETE /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8/os-volume_attachments/a08c99ae-9d28-4c7d-bd78-b7fffb162465" status: 202 len: 0 microversion: 2.1 time: 0.195308 Aug 12 11:56:10.684512 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 415/835] 10.222.0.42 () {58 vars in 1416 bytes} [Fri Aug 12 11:56:10 2022] DELETE /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8/os-volume_attachments/a08c99ae-9d28-4c7d-bd78-b7fffb162465 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:56:10.694062 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-2b48a9e7-9d2a-48ec-a8fb-9675bcc5ded5 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:10.696851 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-2b48a9e7-9d2a-48ec-a8fb-9675bcc5ded5 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:10.703522 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2b48a9e7-9d2a-48ec-a8fb-9675bcc5ded5 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:10.704245 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2b48a9e7-9d2a-48ec-a8fb-9675bcc5ded5 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:10.704688 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2b48a9e7-9d2a-48ec-a8fb-9675bcc5ded5 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:10.705389 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2b48a9e7-9d2a-48ec-a8fb-9675bcc5ded5 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:10.705845 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2b48a9e7-9d2a-48ec-a8fb-9675bcc5ded5 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:10.706270 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2b48a9e7-9d2a-48ec-a8fb-9675bcc5ded5 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:10.737017 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-2b48a9e7-9d2a-48ec-a8fb-9675bcc5ded5 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047434 Aug 12 11:56:10.737797 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 416/836] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Aug 12 11:56:10 2022] GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:56:10.740687 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.objects.instance [None req-624e77f9-94b4-485c-af1c-491c4812536f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lazy-loading 'services' on Instance uuid ddc60294-41d7-4e33-8cca-92dc40f56d6e {{(pid=132281) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:56:10.819650 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-624e77f9-94b4-485c-af1c-491c4812536f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e/os-volume_attachments/3b2d12f5-5cd4-400a-bd71-da7f41baf9b4" status: 202 len: 0 microversion: 2.1 time: 0.191414 Aug 12 11:56:10.823431 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 421/837] 10.222.0.42 () {58 vars in 1416 bytes} [Fri Aug 12 11:56:10 2022] DELETE /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e/os-volume_attachments/3b2d12f5-5cd4-400a-bd71-da7f41baf9b4 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 12 11:56:11.749626 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-4b7471e7-d456-4373-880e-a8a9d3b25498 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:11.752019 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-4b7471e7-d456-4373-880e-a8a9d3b25498 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:11.758846 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4b7471e7-d456-4373-880e-a8a9d3b25498 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:11.759326 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4b7471e7-d456-4373-880e-a8a9d3b25498 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:11.759755 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4b7471e7-d456-4373-880e-a8a9d3b25498 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:11.760444 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4b7471e7-d456-4373-880e-a8a9d3b25498 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:11.760924 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4b7471e7-d456-4373-880e-a8a9d3b25498 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:11.761343 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4b7471e7-d456-4373-880e-a8a9d3b25498 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:11.779183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:11.795279 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-4b7471e7-d456-4373-880e-a8a9d3b25498 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049575 Aug 12 11:56:11.795896 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 417/838] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Aug 12 11:56:11 2022] GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:56:12.809195 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-0d06fe6f-cc00-4d9e-bf73-5f5324407042 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:12.812003 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-0d06fe6f-cc00-4d9e-bf73-5f5324407042 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:12.819189 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0d06fe6f-cc00-4d9e-bf73-5f5324407042 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:12.820008 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0d06fe6f-cc00-4d9e-bf73-5f5324407042 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:12.820800 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0d06fe6f-cc00-4d9e-bf73-5f5324407042 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:12.821561 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0d06fe6f-cc00-4d9e-bf73-5f5324407042 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:12.822070 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0d06fe6f-cc00-4d9e-bf73-5f5324407042 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:12.822889 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-0d06fe6f-cc00-4d9e-bf73-5f5324407042 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:12.857548 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-0d06fe6f-cc00-4d9e-bf73-5f5324407042 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052202 Aug 12 11:56:12.857548 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 422/839] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Aug 12 11:56:12 2022] GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 11:56:12.922822 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-9790bfff-8937-4562-acac-d186d98f0a05 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:12.923410 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-9790bfff-8937-4562-acac-d186d98f0a05 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:12.930897 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9790bfff-8937-4562-acac-d186d98f0a05 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:12.931379 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9790bfff-8937-4562-acac-d186d98f0a05 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:12.931874 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9790bfff-8937-4562-acac-d186d98f0a05 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:12.932566 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9790bfff-8937-4562-acac-d186d98f0a05 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:12.933015 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9790bfff-8937-4562-acac-d186d98f0a05 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:12.933446 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9790bfff-8937-4562-acac-d186d98f0a05 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:12.959233 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-9790bfff-8937-4562-acac-d186d98f0a05 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Going to try to terminate instance {{(pid=132282) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 11:56:13.042188 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-9790bfff-8937-4562-acac-d186d98f0a05 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "DELETE /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8" status: 204 len: 0 microversion: 2.1 time: 0.123192 Aug 12 11:56:13.042939 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 418/840] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Aug 12 11:56:12 2022] DELETE /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 11:56:13.051353 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-72c3e469-200f-4f1f-89d5-7387246d1b39 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:13.051960 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-72c3e469-200f-4f1f-89d5-7387246d1b39 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:13.058346 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-72c3e469-200f-4f1f-89d5-7387246d1b39 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:13.059173 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-72c3e469-200f-4f1f-89d5-7387246d1b39 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:13.059880 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-72c3e469-200f-4f1f-89d5-7387246d1b39 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:13.060867 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-72c3e469-200f-4f1f-89d5-7387246d1b39 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:13.061372 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-72c3e469-200f-4f1f-89d5-7387246d1b39 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:13.062102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-72c3e469-200f-4f1f-89d5-7387246d1b39 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:13.062444 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-7e450225-9b22-4d72-a107-fb382e5df2ec tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:13.065375 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-7e450225-9b22-4d72-a107-fb382e5df2ec tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:13.071349 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7e450225-9b22-4d72-a107-fb382e5df2ec tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:13.071825 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7e450225-9b22-4d72-a107-fb382e5df2ec tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:13.072256 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7e450225-9b22-4d72-a107-fb382e5df2ec tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:13.072944 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7e450225-9b22-4d72-a107-fb382e5df2ec tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:13.073392 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7e450225-9b22-4d72-a107-fb382e5df2ec tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:13.073810 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7e450225-9b22-4d72-a107-fb382e5df2ec tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:13.105263 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-7e450225-9b22-4d72-a107-fb382e5df2ec tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048730 Aug 12 11:56:13.105839 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 419/841] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Aug 12 11:56:13 2022] GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 12 11:56:13.210179 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-72c3e469-200f-4f1f-89d5-7387246d1b39 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:13.217861 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-72c3e469-200f-4f1f-89d5-7387246d1b39 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8" status: 200 len: 1681 microversion: 2.1 time: 0.170916 Aug 12 11:56:13.218447 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 423/842] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:56:13 2022] GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:56:13.224978 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e8fff0b4-b6ff-449a-ad1a-3618c0e4c45e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:13.227209 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-e8fff0b4-b6ff-449a-ad1a-3618c0e4c45e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:13.233171 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e8fff0b4-b6ff-449a-ad1a-3618c0e4c45e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:13.233618 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e8fff0b4-b6ff-449a-ad1a-3618c0e4c45e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:13.234051 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e8fff0b4-b6ff-449a-ad1a-3618c0e4c45e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:13.234760 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e8fff0b4-b6ff-449a-ad1a-3618c0e4c45e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:13.235211 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e8fff0b4-b6ff-449a-ad1a-3618c0e4c45e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:13.235631 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e8fff0b4-b6ff-449a-ad1a-3618c0e4c45e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:13.264135 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e8fff0b4-b6ff-449a-ad1a-3618c0e4c45e tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043543 Aug 12 11:56:13.264664 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 420/843] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Aug 12 11:56:13 2022] GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 11:56:13.328315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-1cb5caf9-7e22-4a2e-a381-d221cdf60d1c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:13.328776 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-1cb5caf9-7e22-4a2e-a381-d221cdf60d1c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:13.335364 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1cb5caf9-7e22-4a2e-a381-d221cdf60d1c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:13.335850 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1cb5caf9-7e22-4a2e-a381-d221cdf60d1c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:13.336286 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1cb5caf9-7e22-4a2e-a381-d221cdf60d1c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:13.336979 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1cb5caf9-7e22-4a2e-a381-d221cdf60d1c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:13.337441 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1cb5caf9-7e22-4a2e-a381-d221cdf60d1c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:13.337867 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1cb5caf9-7e22-4a2e-a381-d221cdf60d1c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:13.365151 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-1cb5caf9-7e22-4a2e-a381-d221cdf60d1c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Going to try to terminate instance {{(pid=132281) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 11:56:13.443766 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-1cb5caf9-7e22-4a2e-a381-d221cdf60d1c tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e" status: 204 len: 0 microversion: 2.1 time: 0.119165 Aug 12 11:56:13.444540 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 424/844] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Aug 12 11:56:13 2022] DELETE /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 11:56:13.452832 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-595d1f0b-c975-4789-bc47-40868caf4f4b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:13.453440 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-595d1f0b-c975-4789-bc47-40868caf4f4b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:13.459846 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-595d1f0b-c975-4789-bc47-40868caf4f4b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:13.460324 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-595d1f0b-c975-4789-bc47-40868caf4f4b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:13.460756 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-595d1f0b-c975-4789-bc47-40868caf4f4b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:13.461434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-595d1f0b-c975-4789-bc47-40868caf4f4b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:13.461883 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-595d1f0b-c975-4789-bc47-40868caf4f4b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:13.462303 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-595d1f0b-c975-4789-bc47-40868caf4f4b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:13.595335 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-595d1f0b-c975-4789-bc47-40868caf4f4b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:13.602906 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-595d1f0b-c975-4789-bc47-40868caf4f4b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e" status: 200 len: 1674 microversion: 2.1 time: 0.153946 Aug 12 11:56:13.603460 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 421/845] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:56:13 2022] GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:56:14.241868 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-20905ca6-188c-49bb-8b5d-5e03359187ef tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:14.242481 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-20905ca6-188c-49bb-8b5d-5e03359187ef tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:14.248845 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-20905ca6-188c-49bb-8b5d-5e03359187ef tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:14.249322 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-20905ca6-188c-49bb-8b5d-5e03359187ef tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:14.249745 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-20905ca6-188c-49bb-8b5d-5e03359187ef tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:14.250421 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-20905ca6-188c-49bb-8b5d-5e03359187ef tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:14.250988 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-20905ca6-188c-49bb-8b5d-5e03359187ef tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:14.251404 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-20905ca6-188c-49bb-8b5d-5e03359187ef tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:14.386908 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-20905ca6-188c-49bb-8b5d-5e03359187ef tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:14.395261 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-20905ca6-188c-49bb-8b5d-5e03359187ef tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8" status: 200 len: 1681 microversion: 2.1 time: 0.157572 Aug 12 11:56:14.395828 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 425/846] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:56:14 2022] GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:56:14.623276 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-60357bc9-9633-4d0d-b1a8-1f90d1dcf433 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:14.623928 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-60357bc9-9633-4d0d-b1a8-1f90d1dcf433 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:14.630882 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-60357bc9-9633-4d0d-b1a8-1f90d1dcf433 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:14.631487 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-60357bc9-9633-4d0d-b1a8-1f90d1dcf433 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:14.631933 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-60357bc9-9633-4d0d-b1a8-1f90d1dcf433 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:14.632744 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-60357bc9-9633-4d0d-b1a8-1f90d1dcf433 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:14.633204 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-60357bc9-9633-4d0d-b1a8-1f90d1dcf433 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:14.633642 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-60357bc9-9633-4d0d-b1a8-1f90d1dcf433 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:14.766840 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-60357bc9-9633-4d0d-b1a8-1f90d1dcf433 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:14.775912 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-60357bc9-9633-4d0d-b1a8-1f90d1dcf433 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e" status: 200 len: 1674 microversion: 2.1 time: 0.156508 Aug 12 11:56:14.776467 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 422/847] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:56:14 2022] GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:56:15.417714 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-3b5b2779-93a6-4190-b49b-6ea14974a232 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:15.418319 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-3b5b2779-93a6-4190-b49b-6ea14974a232 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:15.425486 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3b5b2779-93a6-4190-b49b-6ea14974a232 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:15.426017 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3b5b2779-93a6-4190-b49b-6ea14974a232 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:15.426455 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3b5b2779-93a6-4190-b49b-6ea14974a232 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:15.427198 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3b5b2779-93a6-4190-b49b-6ea14974a232 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:15.427653 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3b5b2779-93a6-4190-b49b-6ea14974a232 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:15.428068 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3b5b2779-93a6-4190-b49b-6ea14974a232 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:15.557639 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-3b5b2779-93a6-4190-b49b-6ea14974a232 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:15.565874 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-3b5b2779-93a6-4190-b49b-6ea14974a232 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8" status: 200 len: 1681 microversion: 2.1 time: 0.151681 Aug 12 11:56:15.566434 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 426/848] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:56:15 2022] GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:56:15.797906 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-3b6f8fb6-9dc0-463f-8552-0e2789f6db9f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:15.798515 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-3b6f8fb6-9dc0-463f-8552-0e2789f6db9f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:15.804984 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3b6f8fb6-9dc0-463f-8552-0e2789f6db9f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:15.805526 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3b6f8fb6-9dc0-463f-8552-0e2789f6db9f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:15.805912 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3b6f8fb6-9dc0-463f-8552-0e2789f6db9f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:15.806632 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3b6f8fb6-9dc0-463f-8552-0e2789f6db9f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:15.807077 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3b6f8fb6-9dc0-463f-8552-0e2789f6db9f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:15.807568 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3b6f8fb6-9dc0-463f-8552-0e2789f6db9f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:15.941453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-3b6f8fb6-9dc0-463f-8552-0e2789f6db9f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:15.949443 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-3b6f8fb6-9dc0-463f-8552-0e2789f6db9f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e" status: 200 len: 1674 microversion: 2.1 time: 0.155983 Aug 12 11:56:15.950008 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 423/849] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:56:15 2022] GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:56:16.587817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-85d5c199-aa6d-4bdb-8ab3-a6f685d8a5dd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:16.588416 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-85d5c199-aa6d-4bdb-8ab3-a6f685d8a5dd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:16.590836 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:16.596110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-85d5c199-aa6d-4bdb-8ab3-a6f685d8a5dd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:16.596618 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-85d5c199-aa6d-4bdb-8ab3-a6f685d8a5dd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:16.597304 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-85d5c199-aa6d-4bdb-8ab3-a6f685d8a5dd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:16.598038 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-85d5c199-aa6d-4bdb-8ab3-a6f685d8a5dd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:16.598731 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-85d5c199-aa6d-4bdb-8ab3-a6f685d8a5dd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:16.599459 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-85d5c199-aa6d-4bdb-8ab3-a6f685d8a5dd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:16.604581 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:16.789688 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-85d5c199-aa6d-4bdb-8ab3-a6f685d8a5dd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:16.797150 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-85d5c199-aa6d-4bdb-8ab3-a6f685d8a5dd tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8" status: 200 len: 1681 microversion: 2.1 time: 0.213191 Aug 12 11:56:16.797724 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 427/850] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:56:16 2022] GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8 => generated 1681 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:56:16.970640 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-8e5c2a9f-e95e-49f2-abf6-ee4551019374 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:16.971256 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-8e5c2a9f-e95e-49f2-abf6-ee4551019374 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:16.977949 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8e5c2a9f-e95e-49f2-abf6-ee4551019374 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:16.978537 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8e5c2a9f-e95e-49f2-abf6-ee4551019374 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:16.979098 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8e5c2a9f-e95e-49f2-abf6-ee4551019374 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:16.979792 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8e5c2a9f-e95e-49f2-abf6-ee4551019374 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:16.980248 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8e5c2a9f-e95e-49f2-abf6-ee4551019374 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:16.980672 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8e5c2a9f-e95e-49f2-abf6-ee4551019374 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:17.308027 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-8e5c2a9f-e95e-49f2-abf6-ee4551019374 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:17.315973 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-8e5c2a9f-e95e-49f2-abf6-ee4551019374 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e" status: 200 len: 1674 microversion: 2.1 time: 0.349324 Aug 12 11:56:17.316531 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 424/851] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:56:16 2022] GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e => generated 1674 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:56:17.821789 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-4e6a6386-dd4b-4268-bc08-22acc7ef58f5 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:17.823339 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-4e6a6386-dd4b-4268-bc08-22acc7ef58f5 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:17.831555 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4e6a6386-dd4b-4268-bc08-22acc7ef58f5 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:17.832147 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4e6a6386-dd4b-4268-bc08-22acc7ef58f5 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:17.832922 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4e6a6386-dd4b-4268-bc08-22acc7ef58f5 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:17.833986 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4e6a6386-dd4b-4268-bc08-22acc7ef58f5 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:17.834696 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4e6a6386-dd4b-4268-bc08-22acc7ef58f5 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:17.835214 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4e6a6386-dd4b-4268-bc08-22acc7ef58f5 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:17.928623 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-4e6a6386-dd4b-4268-bc08-22acc7ef58f5 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:17.936073 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-4e6a6386-dd4b-4268-bc08-22acc7ef58f5 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8" status: 200 len: 1613 microversion: 2.1 time: 0.118171 Aug 12 11:56:17.946779 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 428/852] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:56:17 2022] GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8 => generated 1613 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:56:18.338030 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-bfdd90c7-cf79-4684-89d7-3c53b538a817 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:18.342075 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-bfdd90c7-cf79-4684-89d7-3c53b538a817 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:18.346626 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-99d70fc7-ccb3-409e-a573-6c4421cfa340 req-dd759e89-969b-432f-883b-4f7fa527542e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc60294-41d7-4e33-8cca-92dc40f56d6e", "name": "network-vif-deleted", "tag": "827eeddd-31a3-4650-a207-f6b99b7b49d3"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:56:18.363038 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bfdd90c7-cf79-4684-89d7-3c53b538a817 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:18.363249 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bfdd90c7-cf79-4684-89d7-3c53b538a817 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:18.363872 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bfdd90c7-cf79-4684-89d7-3c53b538a817 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:18.364949 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bfdd90c7-cf79-4684-89d7-3c53b538a817 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:18.365970 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bfdd90c7-cf79-4684-89d7-3c53b538a817 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:18.366625 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bfdd90c7-cf79-4684-89d7-3c53b538a817 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:18.374163 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-99d70fc7-ccb3-409e-a573-6c4421cfa340 req-dd759e89-969b-432f-883b-4f7fa527542e service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:18.375557 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-99d70fc7-ccb3-409e-a573-6c4421cfa340 req-dd759e89-969b-432f-883b-4f7fa527542e service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:18.376156 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-99d70fc7-ccb3-409e-a573-6c4421cfa340 req-dd759e89-969b-432f-883b-4f7fa527542e service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:18.419866 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-99d70fc7-ccb3-409e-a573-6c4421cfa340 req-dd759e89-969b-432f-883b-4f7fa527542e service nova] Creating event network-vif-deleted:827eeddd-31a3-4650-a207-f6b99b7b49d3 for instance ddc60294-41d7-4e33-8cca-92dc40f56d6e on hv-cinder-85282 Aug 12 11:56:18.427918 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-99d70fc7-ccb3-409e-a573-6c4421cfa340 req-dd759e89-969b-432f-883b-4f7fa527542e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086729 Aug 12 11:56:18.428818 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 429/853] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:56:18.444019 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-bfdd90c7-cf79-4684-89d7-3c53b538a817 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381f8ca947954e01b6255626d4a2888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebdd96e25642468903a1657a8ee82d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:18.452787 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-bfdd90c7-cf79-4684-89d7-3c53b538a817 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e" status: 200 len: 1607 microversion: 2.1 time: 0.118837 Aug 12 11:56:18.453864 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 425/854] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:56:18 2022] GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e => generated 1607 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:56:18.958382 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-1eaa3dd0-f26b-4723-a024-1457c9408102 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:18.959692 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-1eaa3dd0-f26b-4723-a024-1457c9408102 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:18.965793 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1eaa3dd0-f26b-4723-a024-1457c9408102 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:18.966268 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1eaa3dd0-f26b-4723-a024-1457c9408102 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:18.966895 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1eaa3dd0-f26b-4723-a024-1457c9408102 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:18.967591 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1eaa3dd0-f26b-4723-a024-1457c9408102 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:18.968037 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1eaa3dd0-f26b-4723-a024-1457c9408102 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:18.968658 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1eaa3dd0-f26b-4723-a024-1457c9408102 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:19.004648 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1eaa3dd0-f26b-4723-a024-1457c9408102 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:19.005132 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1eaa3dd0-f26b-4723-a024-1457c9408102 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:19.005592 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1eaa3dd0-f26b-4723-a024-1457c9408102 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:19.006229 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.objects.instance [None req-1eaa3dd0-f26b-4723-a024-1457c9408102 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lazy-loading 'fault' on Instance uuid 15bed11d-dd0b-4cc8-ab40-968fdf8689c8 {{(pid=132281) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:56:19.050888 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-1eaa3dd0-f26b-4723-a024-1457c9408102 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a30400dec14a85889af8d8dd59886e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8299891a8d134af4be3f84cdc7abec51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:19.058434 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-1eaa3dd0-f26b-4723-a024-1457c9408102 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8" status: 200 len: 1330 microversion: 2.1 time: 0.104795 Aug 12 11:56:19.059025 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 430/855] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:56:18 2022] GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8 => generated 1330 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:56:19.477808 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-88ea2ceb-8d29-4ff7-8876-43317019c66b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:19.479512 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-88ea2ceb-8d29-4ff7-8876-43317019c66b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:19.485230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-88ea2ceb-8d29-4ff7-8876-43317019c66b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:19.485716 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-88ea2ceb-8d29-4ff7-8876-43317019c66b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:19.486159 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-88ea2ceb-8d29-4ff7-8876-43317019c66b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:19.486886 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-88ea2ceb-8d29-4ff7-8876-43317019c66b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:19.487922 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-88ea2ceb-8d29-4ff7-8876-43317019c66b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:19.488385 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-88ea2ceb-8d29-4ff7-8876-43317019c66b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:19.502491 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.wsgi [None req-88ea2ceb-8d29-4ff7-8876-43317019c66b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] HTTP exception thrown: Instance ddc60294-41d7-4e33-8cca-92dc40f56d6e could not be found. Aug 12 11:56:19.504293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-88ea2ceb-8d29-4ff7-8876-43317019c66b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Request method failure captured: Aug 12 11:56:19.504293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e HTTP/1.1 Aug 12 11:56:19.504293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 11:56:19.504293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 11:56:19.504293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 11:56:19.504293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 0 Aug 12 11:56:19.504293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 11:56:19.504293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 11:56:19.504293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 11:56:19.504293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 11:56:19.504293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9j5kEfCG-tN23X5w95jn5XkxY3U52DBZ_L0GWoiLWEQzz0WA1BQNDsRTE3earO4rAPrqKy1dBuauP7vnvmUsePhyoKYr-NZgS8VVgWSrEJOc5HIRc9IfmS1urw91oJ3OfbkuwhHgYd8t1t_4wf68AVsAUxRV-GI2tagS77oP14cAJ8U Aug 12 11:56:19.504293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 11:56:19.504293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 11:56:19.504293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 11:56:19.504293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 11:56:19.504293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 11:56:19.504293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 11:56:19.504293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: ecebdd96e25642468903a1657a8ee82d Aug 12 11:56:19.504293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-AttachVolumeTestJSON-265366964 Aug 12 11:56:19.504293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 11:56:19.504293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 11:56:19.506015 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ecebdd96e25642468903a1657a8ee82d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ecebdd96e25642468903a1657a8ee82d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ecebdd96e25642468903a1657a8ee82d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ecebdd96e25642468903a1657a8ee82d"}]}] Aug 12 11:56:19.506015 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-AttachVolumeTestJSON-265366964 Aug 12 11:56:19.506015 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: ecebdd96e25642468903a1657a8ee82d Aug 12 11:56:19.506015 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-AttachVolumeTestJSON-265366964 Aug 12 11:56:19.506015 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-AttachVolumeTestJSON-265366964-project Aug 12 11:56:19.506015 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 11:56:19.506015 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 11:56:19.506015 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: 381f8ca947954e01b6255626d4a2888f Aug 12 11:56:19.506015 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-AttachVolumeTestJSON-265366964-project Aug 12 11:56:19.506015 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: > Aug 12 11:56:19.506015 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Instance ddc60294-41d7-4e33-8cca-92dc40f56d6e could not be found. Aug 12 11:56:19.506015 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'id': 'ddc60294-41d7-4e33-8cca-92dc40f56d6e'} Aug 12 11:56:19.507465 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:56:19.507465 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:19.507465 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:56:19.507465 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:56:19.507465 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:56:19.507465 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:56:19.507465 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:56:19.507465 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:56:19.507465 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:56:19.507465 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:56:19.507465 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddc60294-41d7-4e33-8cca-92dc40f56d6e could not be found. Aug 12 11:56:19.507465 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:19.507465 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:19.507465 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:19.507465 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:19.507465 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:19.507465 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:19.507465 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:56:19.507465 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:56:19.507465 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:56:19.509412 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:56:19.509412 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:56:19.509412 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:56:19.509412 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:56:19.509412 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:56:19.509412 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:56:19.509412 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:56:19.509412 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddc60294-41d7-4e33-8cca-92dc40f56d6e could not be found. Aug 12 11:56:19.509412 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:19.509412 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:19.509412 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:19.509412 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:19.509412 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:19.509412 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:19.509412 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:56:19.509412 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:56:19.509412 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddc60294-41d7-4e33-8cca-92dc40f56d6e could not be found. Aug 12 11:56:19.509412 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:19.510823 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-88ea2ceb-8d29-4ff7-8876-43317019c66b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Returning 404 to user: Instance ddc60294-41d7-4e33-8cca-92dc40f56d6e could not be found. {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:56:19.510823 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-88ea2ceb-8d29-4ff7-8876-43317019c66b tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e" status: 404 len: 111 microversion: 2.1 time: 0.034873 Aug 12 11:56:19.510823 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 426/856] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:56:19 2022] GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:56:19.515089 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-a8ce0bea-0fa8-4cd2-ac9e-934636c879b9 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '.version_select at 0x7f3e585fde50>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:19.534495 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-a8ce0bea-0fa8-4cd2-ac9e-934636c879b9 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1940959568" status: 202 len: 0 microversion: 2.1 time: 0.022926 Aug 12 11:56:19.535169 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 431/857] 10.222.0.42 () {58 vars in 1221 bytes} [Fri Aug 12 11:56:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1940959568 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:56:20.082013 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-aa09461d-3d96-4fd4-a79c-148aaf93aed4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:20.082769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-aa09461d-3d96-4fd4-a79c-148aaf93aed4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:20.089243 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-aa09461d-3d96-4fd4-a79c-148aaf93aed4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:20.089732 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-aa09461d-3d96-4fd4-a79c-148aaf93aed4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:20.090194 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-aa09461d-3d96-4fd4-a79c-148aaf93aed4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:20.090922 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-aa09461d-3d96-4fd4-a79c-148aaf93aed4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:20.091371 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-aa09461d-3d96-4fd4-a79c-148aaf93aed4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:20.091794 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-aa09461d-3d96-4fd4-a79c-148aaf93aed4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:20.105145 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.wsgi [None req-aa09461d-3d96-4fd4-a79c-148aaf93aed4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] HTTP exception thrown: Instance 15bed11d-dd0b-4cc8-ab40-968fdf8689c8 could not be found. Aug 12 11:56:20.107046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-aa09461d-3d96-4fd4-a79c-148aaf93aed4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Request method failure captured: Aug 12 11:56:20.107046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8 HTTP/1.1 Aug 12 11:56:20.107046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 11:56:20.107046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 11:56:20.107046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 11:56:20.107046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 0 Aug 12 11:56:20.107046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 11:56:20.107046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 11:56:20.107046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 11:56:20.107046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 11:56:20.107046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9j5b93D9DFn6geUGIXSqCWNPRsOoFCQh7K0YJu6U1z8M-82hV_MMW-0Rx_RsrS3lVH4yCHqvGV-EIGSy6uHXvN26xND935rxaQQze8S1cibmQ_P5YQQSOUKlcTJjvmH8tXnzK6aYRsotianp-i1gOUOwU_1_GVtqTppajmycDWrHY6k Aug 12 11:56:20.107046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 11:56:20.107046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 11:56:20.107046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 11:56:20.107046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 11:56:20.107046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 11:56:20.107046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 11:56:20.107046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: 8299891a8d134af4be3f84cdc7abec51 Aug 12 11:56:20.107046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:56:20.107046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 11:56:20.107046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 11:56:20.108587 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8299891a8d134af4be3f84cdc7abec51", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8299891a8d134af4be3f84cdc7abec51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8299891a8d134af4be3f84cdc7abec51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8299891a8d134af4be3f84cdc7abec51"}]}] Aug 12 11:56:20.108587 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:56:20.108587 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: 8299891a8d134af4be3f84cdc7abec51 Aug 12 11:56:20.108587 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:56:20.108587 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-AttachVolumeNegativeTest-1716385367-project Aug 12 11:56:20.108587 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 11:56:20.108587 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 11:56:20.108587 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: 72a30400dec14a85889af8d8dd59886e Aug 12 11:56:20.108587 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-AttachVolumeNegativeTest-1716385367-project Aug 12 11:56:20.108587 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: > Aug 12 11:56:20.108587 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Instance 15bed11d-dd0b-4cc8-ab40-968fdf8689c8 could not be found. Aug 12 11:56:20.108587 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'id': '15bed11d-dd0b-4cc8-ab40-968fdf8689c8'} Aug 12 11:56:20.109357 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:56:20.109357 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:20.109357 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:56:20.109357 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:56:20.109357 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:56:20.109357 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:56:20.109357 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:56:20.109357 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:56:20.109357 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:56:20.109357 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:56:20.109357 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15bed11d-dd0b-4cc8-ab40-968fdf8689c8 could not be found. Aug 12 11:56:20.109357 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:20.109357 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:20.109357 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:20.109357 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:20.109357 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:20.109357 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:20.109357 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:56:20.109357 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:56:20.109357 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:56:20.110694 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:56:20.110694 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:56:20.110694 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:56:20.110694 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:56:20.110694 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:56:20.110694 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:56:20.110694 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:56:20.110694 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15bed11d-dd0b-4cc8-ab40-968fdf8689c8 could not be found. Aug 12 11:56:20.110694 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:20.110694 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:20.110694 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:20.110694 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:20.110694 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:20.110694 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:20.110694 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:56:20.110694 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:56:20.110694 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15bed11d-dd0b-4cc8-ab40-968fdf8689c8 could not be found. Aug 12 11:56:20.110694 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:20.111844 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-aa09461d-3d96-4fd4-a79c-148aaf93aed4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Returning 404 to user: Instance 15bed11d-dd0b-4cc8-ab40-968fdf8689c8 could not be found. {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:56:20.111844 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-aa09461d-3d96-4fd4-a79c-148aaf93aed4 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8" status: 404 len: 111 microversion: 2.1 time: 0.030667 Aug 12 11:56:20.111844 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 427/858] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:56:20 2022] GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:56:20.117714 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-42477f22-93ec-4449-ac99-f13456f45e90 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '.version_select at 0x7f3e5cb03ca0>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:20.139014 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-42477f22-93ec-4449-ac99-f13456f45e90 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-27166005" status: 202 len: 0 microversion: 2.1 time: 0.025493 Aug 12 11:56:20.139678 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 432/859] 10.222.0.42 () {58 vars in 1215 bytes} [Fri Aug 12 11:56:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-27166005 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:56:20.450356 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-48565a09-bae5-4e7f-bd3b-d61c29803b22 req-57134f06-9715-44bd-a0a9-49b8807a5f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15bed11d-dd0b-4cc8-ab40-968fdf8689c8", "name": "network-vif-deleted", "tag": "74085585-4c60-4395-8719-be2205ab20cc"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:56:20.459548 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-48565a09-bae5-4e7f-bd3b-d61c29803b22 req-57134f06-9715-44bd-a0a9-49b8807a5f76 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:20.460018 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-48565a09-bae5-4e7f-bd3b-d61c29803b22 req-57134f06-9715-44bd-a0a9-49b8807a5f76 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:20.460441 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-48565a09-bae5-4e7f-bd3b-d61c29803b22 req-57134f06-9715-44bd-a0a9-49b8807a5f76 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:20.471499 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-48565a09-bae5-4e7f-bd3b-d61c29803b22 req-57134f06-9715-44bd-a0a9-49b8807a5f76 service nova] Creating event network-vif-deleted:74085585-4c60-4395-8719-be2205ab20cc for instance 15bed11d-dd0b-4cc8-ab40-968fdf8689c8 on hv-cinder-85282 Aug 12 11:56:20.476505 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-48565a09-bae5-4e7f-bd3b-d61c29803b22 req-57134f06-9715-44bd-a0a9-49b8807a5f76 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029834 Aug 12 11:56:20.477106 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 428/860] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:56:21.868478 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-a080d2dc-e8d8-48f5-8094-979ebd17944f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:21.868992 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-a080d2dc-e8d8-48f5-8094-979ebd17944f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:21.874904 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a080d2dc-e8d8-48f5-8094-979ebd17944f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:21.875388 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a080d2dc-e8d8-48f5-8094-979ebd17944f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:21.875826 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a080d2dc-e8d8-48f5-8094-979ebd17944f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:21.876509 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a080d2dc-e8d8-48f5-8094-979ebd17944f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:21.876960 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a080d2dc-e8d8-48f5-8094-979ebd17944f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:21.877376 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a080d2dc-e8d8-48f5-8094-979ebd17944f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:21.891026 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.wsgi [None req-a080d2dc-e8d8-48f5-8094-979ebd17944f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] HTTP exception thrown: Instance 15bed11d-dd0b-4cc8-ab40-968fdf8689c8 could not be found. Aug 12 11:56:21.892647 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-a080d2dc-e8d8-48f5-8094-979ebd17944f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Request method failure captured: Aug 12 11:56:21.892647 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: DELETE /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8 HTTP/1.1 Aug 12 11:56:21.892647 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 11:56:21.892647 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 11:56:21.892647 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 11:56:21.892647 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 0 Aug 12 11:56:21.892647 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 11:56:21.892647 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 11:56:21.892647 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 11:56:21.892647 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 11:56:21.892647 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9j5b93D9DFn6geUGIXSqCWNPRsOoFCQh7K0YJu6U1z8M-82hV_MMW-0Rx_RsrS3lVH4yCHqvGV-EIGSy6uHXvN26xND935rxaQQze8S1cibmQ_P5YQQSOUKlcTJjvmH8tXnzK6aYRsotianp-i1gOUOwU_1_GVtqTppajmycDWrHY6k Aug 12 11:56:21.892647 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 11:56:21.892647 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 11:56:21.892647 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 11:56:21.892647 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 11:56:21.892647 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 11:56:21.892647 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 11:56:21.892647 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: 8299891a8d134af4be3f84cdc7abec51 Aug 12 11:56:21.892647 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:56:21.892647 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 11:56:21.892647 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 11:56:21.894170 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8299891a8d134af4be3f84cdc7abec51", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8299891a8d134af4be3f84cdc7abec51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8299891a8d134af4be3f84cdc7abec51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8299891a8d134af4be3f84cdc7abec51"}]}] Aug 12 11:56:21.894170 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:56:21.894170 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: 8299891a8d134af4be3f84cdc7abec51 Aug 12 11:56:21.894170 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:56:21.894170 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-AttachVolumeNegativeTest-1716385367-project Aug 12 11:56:21.894170 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 11:56:21.894170 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 11:56:21.894170 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: 72a30400dec14a85889af8d8dd59886e Aug 12 11:56:21.894170 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-AttachVolumeNegativeTest-1716385367-project Aug 12 11:56:21.894170 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: > Aug 12 11:56:21.894170 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Instance 15bed11d-dd0b-4cc8-ab40-968fdf8689c8 could not be found. Aug 12 11:56:21.894170 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'id': '15bed11d-dd0b-4cc8-ab40-968fdf8689c8'} Aug 12 11:56:21.895032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:56:21.895032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:21.895032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:56:21.895032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:56:21.895032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:56:21.895032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:56:21.895032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:56:21.895032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:56:21.895032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:56:21.895032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:56:21.895032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15bed11d-dd0b-4cc8-ab40-968fdf8689c8 could not be found. Aug 12 11:56:21.895032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:21.895032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:21.895032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:21.895032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:21.895032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:21.895032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:21.895032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:56:21.895032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:56:21.895032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:56:21.896817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:56:21.896817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 11:56:21.896817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 11:56:21.896817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 11:56:21.896817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 11:56:21.896817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:56:21.896817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:56:21.896817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:56:21.896817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:56:21.896817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15bed11d-dd0b-4cc8-ab40-968fdf8689c8 could not be found. Aug 12 11:56:21.896817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:21.896817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:21.896817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:21.896817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:21.896817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:21.896817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:21.896817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:56:21.896817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:56:21.896817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15bed11d-dd0b-4cc8-ab40-968fdf8689c8 could not be found. Aug 12 11:56:21.896817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:21.898440 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-a080d2dc-e8d8-48f5-8094-979ebd17944f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Returning 404 to user: Instance 15bed11d-dd0b-4cc8-ab40-968fdf8689c8 could not be found. {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:56:21.898440 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-a080d2dc-e8d8-48f5-8094-979ebd17944f tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "DELETE /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8" status: 404 len: 111 microversion: 2.1 time: 0.029907 Aug 12 11:56:21.898440 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 433/861] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Aug 12 11:56:21 2022] DELETE /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 11:56:21.903745 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-824083e4-e801-456c-b7de-15eec5369e9d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:21.904473 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-824083e4-e801-456c-b7de-15eec5369e9d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 15bed11d-dd0b-4cc8-ab40-968fdf8689c8] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:21.910496 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-824083e4-e801-456c-b7de-15eec5369e9d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:21.911004 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-824083e4-e801-456c-b7de-15eec5369e9d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:21.911440 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-824083e4-e801-456c-b7de-15eec5369e9d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:21.912120 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-824083e4-e801-456c-b7de-15eec5369e9d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:21.912572 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-824083e4-e801-456c-b7de-15eec5369e9d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:21.912996 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-824083e4-e801-456c-b7de-15eec5369e9d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:21.926255 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.wsgi [None req-824083e4-e801-456c-b7de-15eec5369e9d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] HTTP exception thrown: Instance 15bed11d-dd0b-4cc8-ab40-968fdf8689c8 could not be found. Aug 12 11:56:21.927876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-824083e4-e801-456c-b7de-15eec5369e9d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Request method failure captured: Aug 12 11:56:21.927876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8 HTTP/1.1 Aug 12 11:56:21.927876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 11:56:21.927876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 11:56:21.927876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 11:56:21.927876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 0 Aug 12 11:56:21.927876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 11:56:21.927876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 11:56:21.927876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 11:56:21.927876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 11:56:21.927876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9j5b93D9DFn6geUGIXSqCWNPRsOoFCQh7K0YJu6U1z8M-82hV_MMW-0Rx_RsrS3lVH4yCHqvGV-EIGSy6uHXvN26xND935rxaQQze8S1cibmQ_P5YQQSOUKlcTJjvmH8tXnzK6aYRsotianp-i1gOUOwU_1_GVtqTppajmycDWrHY6k Aug 12 11:56:21.927876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 11:56:21.927876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 11:56:21.927876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 11:56:21.927876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 11:56:21.927876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 11:56:21.927876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 11:56:21.927876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: 8299891a8d134af4be3f84cdc7abec51 Aug 12 11:56:21.927876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:56:21.927876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 11:56:21.927876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 11:56:21.929396 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8299891a8d134af4be3f84cdc7abec51", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8299891a8d134af4be3f84cdc7abec51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8299891a8d134af4be3f84cdc7abec51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8299891a8d134af4be3f84cdc7abec51"}]}] Aug 12 11:56:21.929396 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:56:21.929396 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: 8299891a8d134af4be3f84cdc7abec51 Aug 12 11:56:21.929396 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:56:21.929396 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-AttachVolumeNegativeTest-1716385367-project Aug 12 11:56:21.929396 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 11:56:21.929396 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 11:56:21.929396 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: 72a30400dec14a85889af8d8dd59886e Aug 12 11:56:21.929396 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-AttachVolumeNegativeTest-1716385367-project Aug 12 11:56:21.929396 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: > Aug 12 11:56:21.929396 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Instance 15bed11d-dd0b-4cc8-ab40-968fdf8689c8 could not be found. Aug 12 11:56:21.929396 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'id': '15bed11d-dd0b-4cc8-ab40-968fdf8689c8'} Aug 12 11:56:21.930468 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:56:21.930468 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:21.930468 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:56:21.930468 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:56:21.930468 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:56:21.930468 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:56:21.930468 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:56:21.930468 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:56:21.930468 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:56:21.930468 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:56:21.930468 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15bed11d-dd0b-4cc8-ab40-968fdf8689c8 could not be found. Aug 12 11:56:21.930468 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:21.930468 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:21.930468 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:21.930468 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:21.930468 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:21.930468 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:21.930468 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:56:21.930468 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:56:21.930468 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:56:21.932068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:56:21.932068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:56:21.932068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:56:21.932068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:56:21.932068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:56:21.932068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:56:21.932068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:56:21.932068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15bed11d-dd0b-4cc8-ab40-968fdf8689c8 could not be found. Aug 12 11:56:21.932068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:21.932068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:21.932068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:21.932068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:21.932068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:21.932068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:21.932068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:56:21.932068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:56:21.932068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15bed11d-dd0b-4cc8-ab40-968fdf8689c8 could not be found. Aug 12 11:56:21.932068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:21.933822 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-824083e4-e801-456c-b7de-15eec5369e9d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Returning 404 to user: Instance 15bed11d-dd0b-4cc8-ab40-968fdf8689c8 could not be found. {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:56:21.933822 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-824083e4-e801-456c-b7de-15eec5369e9d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8" status: 404 len: 111 microversion: 2.1 time: 0.030330 Aug 12 11:56:21.933822 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 429/862] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:56:21 2022] GET /compute/v2.1/servers/15bed11d-dd0b-4cc8-ab40-968fdf8689c8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:56:22.397236 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-d0d0f9e3-36c0-45ef-a7e3-37d3a470f2d5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:22.397724 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-d0d0f9e3-36c0-45ef-a7e3-37d3a470f2d5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:22.404390 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d0d0f9e3-36c0-45ef-a7e3-37d3a470f2d5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:22.404869 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d0d0f9e3-36c0-45ef-a7e3-37d3a470f2d5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:22.405307 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d0d0f9e3-36c0-45ef-a7e3-37d3a470f2d5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:22.406188 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d0d0f9e3-36c0-45ef-a7e3-37d3a470f2d5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:22.406669 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d0d0f9e3-36c0-45ef-a7e3-37d3a470f2d5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:22.407102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d0d0f9e3-36c0-45ef-a7e3-37d3a470f2d5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:22.423856 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.wsgi [None req-d0d0f9e3-36c0-45ef-a7e3-37d3a470f2d5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] HTTP exception thrown: Instance ddc60294-41d7-4e33-8cca-92dc40f56d6e could not be found. Aug 12 11:56:22.426466 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-d0d0f9e3-36c0-45ef-a7e3-37d3a470f2d5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Request method failure captured: Aug 12 11:56:22.426466 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: DELETE /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e HTTP/1.1 Aug 12 11:56:22.426466 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 11:56:22.426466 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 11:56:22.426466 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 11:56:22.426466 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 0 Aug 12 11:56:22.426466 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 11:56:22.426466 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 11:56:22.426466 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 11:56:22.426466 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 11:56:22.426466 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9j5kEfCG-tN23X5w95jn5XkxY3U52DBZ_L0GWoiLWEQzz0WA1BQNDsRTE3earO4rAPrqKy1dBuauP7vnvmUsePhyoKYr-NZgS8VVgWSrEJOc5HIRc9IfmS1urw91oJ3OfbkuwhHgYd8t1t_4wf68AVsAUxRV-GI2tagS77oP14cAJ8U Aug 12 11:56:22.426466 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 11:56:22.426466 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 11:56:22.426466 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 11:56:22.426466 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 11:56:22.426466 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 11:56:22.426466 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 11:56:22.426466 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: ecebdd96e25642468903a1657a8ee82d Aug 12 11:56:22.426466 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-AttachVolumeTestJSON-265366964 Aug 12 11:56:22.426466 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 11:56:22.426466 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 11:56:22.428065 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ecebdd96e25642468903a1657a8ee82d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ecebdd96e25642468903a1657a8ee82d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ecebdd96e25642468903a1657a8ee82d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ecebdd96e25642468903a1657a8ee82d"}]}] Aug 12 11:56:22.428065 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-AttachVolumeTestJSON-265366964 Aug 12 11:56:22.428065 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: ecebdd96e25642468903a1657a8ee82d Aug 12 11:56:22.428065 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-AttachVolumeTestJSON-265366964 Aug 12 11:56:22.428065 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-AttachVolumeTestJSON-265366964-project Aug 12 11:56:22.428065 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 11:56:22.428065 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 11:56:22.428065 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: 381f8ca947954e01b6255626d4a2888f Aug 12 11:56:22.428065 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-AttachVolumeTestJSON-265366964-project Aug 12 11:56:22.428065 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: > Aug 12 11:56:22.428065 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Instance ddc60294-41d7-4e33-8cca-92dc40f56d6e could not be found. Aug 12 11:56:22.428065 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'id': 'ddc60294-41d7-4e33-8cca-92dc40f56d6e'} Aug 12 11:56:22.428963 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:56:22.428963 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:22.428963 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:56:22.428963 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:56:22.428963 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:56:22.428963 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:56:22.428963 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:56:22.428963 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:56:22.428963 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:56:22.428963 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:56:22.428963 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddc60294-41d7-4e33-8cca-92dc40f56d6e could not be found. Aug 12 11:56:22.428963 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:22.428963 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:22.428963 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:22.428963 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:22.428963 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:22.428963 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:22.428963 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:56:22.428963 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:56:22.428963 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:56:22.430507 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:56:22.430507 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 11:56:22.430507 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 11:56:22.430507 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 11:56:22.430507 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 11:56:22.430507 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:56:22.430507 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:56:22.430507 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:56:22.430507 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:56:22.430507 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddc60294-41d7-4e33-8cca-92dc40f56d6e could not be found. Aug 12 11:56:22.430507 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:22.430507 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:22.430507 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:22.430507 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:22.430507 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:22.430507 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:22.430507 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:56:22.430507 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:56:22.430507 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddc60294-41d7-4e33-8cca-92dc40f56d6e could not be found. Aug 12 11:56:22.430507 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:22.431895 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-d0d0f9e3-36c0-45ef-a7e3-37d3a470f2d5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Returning 404 to user: Instance ddc60294-41d7-4e33-8cca-92dc40f56d6e could not be found. {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:56:22.431895 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-d0d0f9e3-36c0-45ef-a7e3-37d3a470f2d5 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e" status: 404 len: 111 microversion: 2.1 time: 0.034888 Aug 12 11:56:22.431895 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 434/863] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Aug 12 11:56:22 2022] DELETE /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:56:22.437726 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-2dae9668-2bf2-4862-9fb9-96a300f7f068 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:22.438368 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-2dae9668-2bf2-4862-9fb9-96a300f7f068 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: ddc60294-41d7-4e33-8cca-92dc40f56d6e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:22.444986 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2dae9668-2bf2-4862-9fb9-96a300f7f068 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:22.445653 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2dae9668-2bf2-4862-9fb9-96a300f7f068 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:22.446088 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2dae9668-2bf2-4862-9fb9-96a300f7f068 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:22.447009 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2dae9668-2bf2-4862-9fb9-96a300f7f068 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:22.447448 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2dae9668-2bf2-4862-9fb9-96a300f7f068 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:22.447875 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2dae9668-2bf2-4862-9fb9-96a300f7f068 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:22.463652 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.wsgi [None req-2dae9668-2bf2-4862-9fb9-96a300f7f068 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] HTTP exception thrown: Instance ddc60294-41d7-4e33-8cca-92dc40f56d6e could not be found. Aug 12 11:56:22.465509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-2dae9668-2bf2-4862-9fb9-96a300f7f068 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Request method failure captured: Aug 12 11:56:22.465509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e HTTP/1.1 Aug 12 11:56:22.465509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 11:56:22.465509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 11:56:22.465509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 11:56:22.465509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 0 Aug 12 11:56:22.465509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 11:56:22.465509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 11:56:22.465509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 11:56:22.465509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 11:56:22.465509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9j5kEfCG-tN23X5w95jn5XkxY3U52DBZ_L0GWoiLWEQzz0WA1BQNDsRTE3earO4rAPrqKy1dBuauP7vnvmUsePhyoKYr-NZgS8VVgWSrEJOc5HIRc9IfmS1urw91oJ3OfbkuwhHgYd8t1t_4wf68AVsAUxRV-GI2tagS77oP14cAJ8U Aug 12 11:56:22.465509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 11:56:22.465509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 11:56:22.465509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 11:56:22.465509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 11:56:22.465509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 11:56:22.465509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 11:56:22.465509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: ecebdd96e25642468903a1657a8ee82d Aug 12 11:56:22.465509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-AttachVolumeTestJSON-265366964 Aug 12 11:56:22.465509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 11:56:22.465509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 11:56:22.467087 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ecebdd96e25642468903a1657a8ee82d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ecebdd96e25642468903a1657a8ee82d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ecebdd96e25642468903a1657a8ee82d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ecebdd96e25642468903a1657a8ee82d"}]}] Aug 12 11:56:22.467087 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-AttachVolumeTestJSON-265366964 Aug 12 11:56:22.467087 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: ecebdd96e25642468903a1657a8ee82d Aug 12 11:56:22.467087 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-AttachVolumeTestJSON-265366964 Aug 12 11:56:22.467087 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-AttachVolumeTestJSON-265366964-project Aug 12 11:56:22.467087 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 11:56:22.467087 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 11:56:22.467087 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: 381f8ca947954e01b6255626d4a2888f Aug 12 11:56:22.467087 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-AttachVolumeTestJSON-265366964-project Aug 12 11:56:22.467087 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: > Aug 12 11:56:22.467087 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Instance ddc60294-41d7-4e33-8cca-92dc40f56d6e could not be found. Aug 12 11:56:22.467087 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'id': 'ddc60294-41d7-4e33-8cca-92dc40f56d6e'} Aug 12 11:56:22.467932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:56:22.467932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:22.467932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:56:22.467932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:56:22.467932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:56:22.467932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:56:22.467932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:56:22.467932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:56:22.467932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:56:22.467932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:56:22.467932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddc60294-41d7-4e33-8cca-92dc40f56d6e could not be found. Aug 12 11:56:22.467932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:22.467932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:22.467932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:22.467932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:22.467932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:22.467932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:22.467932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:56:22.467932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:56:22.467932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:56:22.469176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:56:22.469176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:56:22.469176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:56:22.469176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:56:22.469176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:56:22.469176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:56:22.469176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:56:22.469176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddc60294-41d7-4e33-8cca-92dc40f56d6e could not be found. Aug 12 11:56:22.469176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:22.469176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:22.469176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:22.469176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:22.469176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:22.469176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:22.469176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:56:22.469176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:56:22.469176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddc60294-41d7-4e33-8cca-92dc40f56d6e could not be found. Aug 12 11:56:22.469176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:22.470243 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-2dae9668-2bf2-4862-9fb9-96a300f7f068 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Returning 404 to user: Instance ddc60294-41d7-4e33-8cca-92dc40f56d6e could not be found. {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:56:22.470243 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-2dae9668-2bf2-4862-9fb9-96a300f7f068 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e" status: 404 len: 111 microversion: 2.1 time: 0.033717 Aug 12 11:56:22.470243 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 430/864] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:56:22 2022] GET /compute/v2.1/servers/ddc60294-41d7-4e33-8cca-92dc40f56d6e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:56:23.063467 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-eab6d05a-a653-4790-aed6-8225d68e1695 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:23.063955 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-eab6d05a-a653-4790-aed6-8225d68e1695 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: e6216214-8daa-47dc-88aa-c9af7a623f64] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:23.070980 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-eab6d05a-a653-4790-aed6-8225d68e1695 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:23.071459 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-eab6d05a-a653-4790-aed6-8225d68e1695 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:23.071888 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-eab6d05a-a653-4790-aed6-8225d68e1695 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:23.072570 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-eab6d05a-a653-4790-aed6-8225d68e1695 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:23.073022 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-eab6d05a-a653-4790-aed6-8225d68e1695 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:23.073443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-eab6d05a-a653-4790-aed6-8225d68e1695 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:23.087294 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.wsgi [None req-eab6d05a-a653-4790-aed6-8225d68e1695 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] HTTP exception thrown: Instance e6216214-8daa-47dc-88aa-c9af7a623f64 could not be found. Aug 12 11:56:23.088880 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-eab6d05a-a653-4790-aed6-8225d68e1695 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Request method failure captured: Aug 12 11:56:23.088880 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: DELETE /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64 HTTP/1.1 Aug 12 11:56:23.088880 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 11:56:23.088880 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 11:56:23.088880 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 11:56:23.088880 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 0 Aug 12 11:56:23.088880 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 11:56:23.088880 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 11:56:23.088880 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 11:56:23.088880 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 11:56:23.088880 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9j5b93D9DFn6geUGIXSqCWNPRsOoFCQh7K0YJu6U1z8M-82hV_MMW-0Rx_RsrS3lVH4yCHqvGV-EIGSy6uHXvN26xND935rxaQQze8S1cibmQ_P5YQQSOUKlcTJjvmH8tXnzK6aYRsotianp-i1gOUOwU_1_GVtqTppajmycDWrHY6k Aug 12 11:56:23.088880 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 11:56:23.088880 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 11:56:23.088880 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 11:56:23.088880 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 11:56:23.088880 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 11:56:23.088880 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 11:56:23.088880 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: 8299891a8d134af4be3f84cdc7abec51 Aug 12 11:56:23.088880 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:56:23.088880 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 11:56:23.088880 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 11:56:23.090692 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8299891a8d134af4be3f84cdc7abec51", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8299891a8d134af4be3f84cdc7abec51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8299891a8d134af4be3f84cdc7abec51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8299891a8d134af4be3f84cdc7abec51"}]}] Aug 12 11:56:23.090692 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:56:23.090692 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: 8299891a8d134af4be3f84cdc7abec51 Aug 12 11:56:23.090692 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:56:23.090692 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-AttachVolumeNegativeTest-1716385367-project Aug 12 11:56:23.090692 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 11:56:23.090692 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 11:56:23.090692 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: 72a30400dec14a85889af8d8dd59886e Aug 12 11:56:23.090692 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-AttachVolumeNegativeTest-1716385367-project Aug 12 11:56:23.090692 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: > Aug 12 11:56:23.090692 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Instance e6216214-8daa-47dc-88aa-c9af7a623f64 could not be found. Aug 12 11:56:23.090692 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'id': 'e6216214-8daa-47dc-88aa-c9af7a623f64'} Aug 12 11:56:23.091683 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:56:23.091683 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:23.091683 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:56:23.091683 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:56:23.091683 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:56:23.091683 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:56:23.091683 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:56:23.091683 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:56:23.091683 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:56:23.091683 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:56:23.091683 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6216214-8daa-47dc-88aa-c9af7a623f64 could not be found. Aug 12 11:56:23.091683 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.091683 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:23.091683 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.091683 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:23.091683 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:23.091683 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:23.091683 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:56:23.091683 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:56:23.091683 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:56:23.092924 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:56:23.092924 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 11:56:23.092924 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 11:56:23.092924 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 11:56:23.092924 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 11:56:23.092924 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:56:23.092924 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:56:23.092924 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:56:23.092924 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:56:23.092924 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6216214-8daa-47dc-88aa-c9af7a623f64 could not be found. Aug 12 11:56:23.092924 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.092924 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:23.092924 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.092924 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:23.092924 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:23.092924 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:23.092924 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:56:23.092924 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:56:23.092924 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6216214-8daa-47dc-88aa-c9af7a623f64 could not be found. Aug 12 11:56:23.092924 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.094235 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-eab6d05a-a653-4790-aed6-8225d68e1695 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Returning 404 to user: Instance e6216214-8daa-47dc-88aa-c9af7a623f64 could not be found. {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:56:23.094235 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-eab6d05a-a653-4790-aed6-8225d68e1695 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64" status: 404 len: 111 microversion: 2.1 time: 0.030908 Aug 12 11:56:23.094235 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 435/865] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Aug 12 11:56:23 2022] DELETE /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:56:23.099067 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d6c51ff1-30e2-4333-8e3f-7ae6fd7eb3da tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:23.099890 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d6c51ff1-30e2-4333-8e3f-7ae6fd7eb3da tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: e6216214-8daa-47dc-88aa-c9af7a623f64] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:23.106800 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d6c51ff1-30e2-4333-8e3f-7ae6fd7eb3da tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:23.107292 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d6c51ff1-30e2-4333-8e3f-7ae6fd7eb3da tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:23.107726 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d6c51ff1-30e2-4333-8e3f-7ae6fd7eb3da tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:23.108598 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d6c51ff1-30e2-4333-8e3f-7ae6fd7eb3da tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:23.109054 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d6c51ff1-30e2-4333-8e3f-7ae6fd7eb3da tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:23.109483 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d6c51ff1-30e2-4333-8e3f-7ae6fd7eb3da tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:23.125384 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.wsgi [None req-d6c51ff1-30e2-4333-8e3f-7ae6fd7eb3da tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] HTTP exception thrown: Instance e6216214-8daa-47dc-88aa-c9af7a623f64 could not be found. Aug 12 11:56:23.127094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d6c51ff1-30e2-4333-8e3f-7ae6fd7eb3da tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Request method failure captured: Aug 12 11:56:23.127094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64 HTTP/1.1 Aug 12 11:56:23.127094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 11:56:23.127094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 11:56:23.127094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 11:56:23.127094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 0 Aug 12 11:56:23.127094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 11:56:23.127094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 11:56:23.127094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 11:56:23.127094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 11:56:23.127094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9j5b93D9DFn6geUGIXSqCWNPRsOoFCQh7K0YJu6U1z8M-82hV_MMW-0Rx_RsrS3lVH4yCHqvGV-EIGSy6uHXvN26xND935rxaQQze8S1cibmQ_P5YQQSOUKlcTJjvmH8tXnzK6aYRsotianp-i1gOUOwU_1_GVtqTppajmycDWrHY6k Aug 12 11:56:23.127094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 11:56:23.127094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 11:56:23.127094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 11:56:23.127094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 11:56:23.127094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 11:56:23.127094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 11:56:23.127094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: 8299891a8d134af4be3f84cdc7abec51 Aug 12 11:56:23.127094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:56:23.127094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 11:56:23.127094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 11:56:23.129479 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8299891a8d134af4be3f84cdc7abec51", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8299891a8d134af4be3f84cdc7abec51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8299891a8d134af4be3f84cdc7abec51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8299891a8d134af4be3f84cdc7abec51"}]}] Aug 12 11:56:23.129479 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:56:23.129479 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: 8299891a8d134af4be3f84cdc7abec51 Aug 12 11:56:23.129479 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:56:23.129479 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-AttachVolumeNegativeTest-1716385367-project Aug 12 11:56:23.129479 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 11:56:23.129479 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 11:56:23.129479 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: 72a30400dec14a85889af8d8dd59886e Aug 12 11:56:23.129479 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-AttachVolumeNegativeTest-1716385367-project Aug 12 11:56:23.129479 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: > Aug 12 11:56:23.129479 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Instance e6216214-8daa-47dc-88aa-c9af7a623f64 could not be found. Aug 12 11:56:23.129479 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'id': 'e6216214-8daa-47dc-88aa-c9af7a623f64'} Aug 12 11:56:23.130798 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:56:23.130798 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:23.130798 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:56:23.130798 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:56:23.130798 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:56:23.130798 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:56:23.130798 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:56:23.130798 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:56:23.130798 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:56:23.130798 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:56:23.130798 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6216214-8daa-47dc-88aa-c9af7a623f64 could not be found. Aug 12 11:56:23.130798 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.130798 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:23.130798 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.130798 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:23.130798 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:23.130798 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:23.130798 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:56:23.130798 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:56:23.130798 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:56:23.132544 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:56:23.132544 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:56:23.132544 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:56:23.132544 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:56:23.132544 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:56:23.132544 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:56:23.132544 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:56:23.132544 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6216214-8daa-47dc-88aa-c9af7a623f64 could not be found. Aug 12 11:56:23.132544 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.132544 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:23.132544 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.132544 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:23.132544 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:23.132544 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:23.132544 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:56:23.132544 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:56:23.132544 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6216214-8daa-47dc-88aa-c9af7a623f64 could not be found. Aug 12 11:56:23.132544 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.134124 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d6c51ff1-30e2-4333-8e3f-7ae6fd7eb3da tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Returning 404 to user: Instance e6216214-8daa-47dc-88aa-c9af7a623f64 could not be found. {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:56:23.134124 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-d6c51ff1-30e2-4333-8e3f-7ae6fd7eb3da tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64" status: 404 len: 111 microversion: 2.1 time: 0.034329 Aug 12 11:56:23.134124 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 431/866] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:56:23 2022] GET /compute/v2.1/servers/e6216214-8daa-47dc-88aa-c9af7a623f64 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:56:23.137923 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-91706ced-aba4-4770-a26f-64971d37780d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:23.138411 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-91706ced-aba4-4770-a26f-64971d37780d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:23.144994 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-91706ced-aba4-4770-a26f-64971d37780d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:23.145465 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-91706ced-aba4-4770-a26f-64971d37780d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:23.145889 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-91706ced-aba4-4770-a26f-64971d37780d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:23.146563 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-91706ced-aba4-4770-a26f-64971d37780d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:23.147031 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-91706ced-aba4-4770-a26f-64971d37780d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:23.147448 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-91706ced-aba4-4770-a26f-64971d37780d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:23.160370 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.wsgi [None req-91706ced-aba4-4770-a26f-64971d37780d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] HTTP exception thrown: Instance 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f could not be found. Aug 12 11:56:23.161871 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-91706ced-aba4-4770-a26f-64971d37780d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Request method failure captured: Aug 12 11:56:23.161871 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: DELETE /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f HTTP/1.1 Aug 12 11:56:23.161871 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 11:56:23.161871 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 11:56:23.161871 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 11:56:23.161871 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 0 Aug 12 11:56:23.161871 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 11:56:23.161871 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 11:56:23.161871 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 11:56:23.161871 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 11:56:23.161871 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9j5b93D9DFn6geUGIXSqCWNPRsOoFCQh7K0YJu6U1z8M-82hV_MMW-0Rx_RsrS3lVH4yCHqvGV-EIGSy6uHXvN26xND935rxaQQze8S1cibmQ_P5YQQSOUKlcTJjvmH8tXnzK6aYRsotianp-i1gOUOwU_1_GVtqTppajmycDWrHY6k Aug 12 11:56:23.161871 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 11:56:23.161871 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 11:56:23.161871 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 11:56:23.161871 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 11:56:23.161871 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 11:56:23.161871 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 11:56:23.161871 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: 8299891a8d134af4be3f84cdc7abec51 Aug 12 11:56:23.161871 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:56:23.161871 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 11:56:23.161871 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 11:56:23.163427 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8299891a8d134af4be3f84cdc7abec51", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8299891a8d134af4be3f84cdc7abec51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8299891a8d134af4be3f84cdc7abec51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8299891a8d134af4be3f84cdc7abec51"}]}] Aug 12 11:56:23.163427 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:56:23.163427 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: 8299891a8d134af4be3f84cdc7abec51 Aug 12 11:56:23.163427 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:56:23.163427 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-AttachVolumeNegativeTest-1716385367-project Aug 12 11:56:23.163427 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 11:56:23.163427 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 11:56:23.163427 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: 72a30400dec14a85889af8d8dd59886e Aug 12 11:56:23.163427 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-AttachVolumeNegativeTest-1716385367-project Aug 12 11:56:23.163427 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: > Aug 12 11:56:23.163427 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Instance 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f could not be found. Aug 12 11:56:23.163427 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'id': '4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f'} Aug 12 11:56:23.164373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:56:23.164373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:23.164373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:56:23.164373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:56:23.164373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:56:23.164373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:56:23.164373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:56:23.164373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:56:23.164373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:56:23.164373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:56:23.164373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f could not be found. Aug 12 11:56:23.164373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.164373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:23.164373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.164373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:23.164373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:23.164373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:23.164373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:56:23.164373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:56:23.164373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:56:23.165583 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:56:23.165583 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 11:56:23.165583 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 11:56:23.165583 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 11:56:23.165583 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 11:56:23.165583 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:56:23.165583 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:56:23.165583 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:56:23.165583 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:56:23.165583 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f could not be found. Aug 12 11:56:23.165583 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.165583 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:23.165583 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.165583 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:23.165583 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:23.165583 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:23.165583 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:56:23.165583 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:56:23.165583 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f could not be found. Aug 12 11:56:23.165583 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.166916 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-91706ced-aba4-4770-a26f-64971d37780d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Returning 404 to user: Instance 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f could not be found. {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:56:23.166916 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-91706ced-aba4-4770-a26f-64971d37780d tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f" status: 404 len: 111 microversion: 2.1 time: 0.029134 Aug 12 11:56:23.166916 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 436/867] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Aug 12 11:56:23 2022] DELETE /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:56:23.171571 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-3f64b4b3-2047-4c16-8a21-3baebcd2a4eb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:23.172184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-3f64b4b3-2047-4c16-8a21-3baebcd2a4eb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:23.178057 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3f64b4b3-2047-4c16-8a21-3baebcd2a4eb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:23.178532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3f64b4b3-2047-4c16-8a21-3baebcd2a4eb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:23.178998 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3f64b4b3-2047-4c16-8a21-3baebcd2a4eb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:23.179681 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3f64b4b3-2047-4c16-8a21-3baebcd2a4eb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:23.180137 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3f64b4b3-2047-4c16-8a21-3baebcd2a4eb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:23.180561 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-3f64b4b3-2047-4c16-8a21-3baebcd2a4eb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:23.195506 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.wsgi [None req-3f64b4b3-2047-4c16-8a21-3baebcd2a4eb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] HTTP exception thrown: Instance 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f could not be found. Aug 12 11:56:23.197095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-3f64b4b3-2047-4c16-8a21-3baebcd2a4eb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Request method failure captured: Aug 12 11:56:23.197095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f HTTP/1.1 Aug 12 11:56:23.197095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 11:56:23.197095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 11:56:23.197095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 11:56:23.197095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 0 Aug 12 11:56:23.197095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 11:56:23.197095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 11:56:23.197095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 11:56:23.197095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 11:56:23.197095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9j5b93D9DFn6geUGIXSqCWNPRsOoFCQh7K0YJu6U1z8M-82hV_MMW-0Rx_RsrS3lVH4yCHqvGV-EIGSy6uHXvN26xND935rxaQQze8S1cibmQ_P5YQQSOUKlcTJjvmH8tXnzK6aYRsotianp-i1gOUOwU_1_GVtqTppajmycDWrHY6k Aug 12 11:56:23.197095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 11:56:23.197095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 11:56:23.197095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 11:56:23.197095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 11:56:23.197095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 11:56:23.197095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 11:56:23.197095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: 8299891a8d134af4be3f84cdc7abec51 Aug 12 11:56:23.197095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:56:23.197095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 11:56:23.197095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 11:56:23.198836 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8299891a8d134af4be3f84cdc7abec51", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8299891a8d134af4be3f84cdc7abec51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8299891a8d134af4be3f84cdc7abec51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8299891a8d134af4be3f84cdc7abec51"}]}] Aug 12 11:56:23.198836 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:56:23.198836 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: 8299891a8d134af4be3f84cdc7abec51 Aug 12 11:56:23.198836 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:56:23.198836 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-AttachVolumeNegativeTest-1716385367-project Aug 12 11:56:23.198836 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 11:56:23.198836 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 11:56:23.198836 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: 72a30400dec14a85889af8d8dd59886e Aug 12 11:56:23.198836 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-AttachVolumeNegativeTest-1716385367-project Aug 12 11:56:23.198836 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: > Aug 12 11:56:23.198836 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Instance 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f could not be found. Aug 12 11:56:23.198836 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'id': '4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f'} Aug 12 11:56:23.199791 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:56:23.199791 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:23.199791 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:56:23.199791 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:56:23.199791 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:56:23.199791 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:56:23.199791 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:56:23.199791 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:56:23.199791 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:56:23.199791 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:56:23.199791 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f could not be found. Aug 12 11:56:23.199791 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.199791 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:23.199791 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.199791 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:23.199791 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:23.199791 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:23.199791 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:56:23.199791 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:56:23.199791 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:56:23.201209 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:56:23.201209 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:56:23.201209 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:56:23.201209 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:56:23.201209 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:56:23.201209 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:56:23.201209 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:56:23.201209 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f could not be found. Aug 12 11:56:23.201209 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.201209 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:23.201209 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.201209 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:23.201209 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:23.201209 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:23.201209 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:56:23.201209 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:56:23.201209 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f could not be found. Aug 12 11:56:23.201209 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.202336 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-3f64b4b3-2047-4c16-8a21-3baebcd2a4eb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Returning 404 to user: Instance 4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f could not be found. {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:56:23.202336 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-3f64b4b3-2047-4c16-8a21-3baebcd2a4eb tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f" status: 404 len: 111 microversion: 2.1 time: 0.030734 Aug 12 11:56:23.202957 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 432/868] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:56:23 2022] GET /compute/v2.1/servers/4b450db1-0dc9-4ea0-bbc1-dc14f3f3862f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:56:23.622762 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-43658254-5517-4cba-8d91-7f954fbf9701 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:23.623241 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-43658254-5517-4cba-8d91-7f954fbf9701 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:23.634315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-43658254-5517-4cba-8d91-7f954fbf9701 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:23.634828 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-43658254-5517-4cba-8d91-7f954fbf9701 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:23.635286 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-43658254-5517-4cba-8d91-7f954fbf9701 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:23.635977 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-43658254-5517-4cba-8d91-7f954fbf9701 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:23.636426 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-43658254-5517-4cba-8d91-7f954fbf9701 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:23.636845 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-43658254-5517-4cba-8d91-7f954fbf9701 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:23.650587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.wsgi [None req-43658254-5517-4cba-8d91-7f954fbf9701 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] HTTP exception thrown: Instance 6dba7589-a4cf-4842-953b-0218eae4d3db could not be found. Aug 12 11:56:23.652169 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-43658254-5517-4cba-8d91-7f954fbf9701 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Request method failure captured: Aug 12 11:56:23.652169 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: DELETE /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db HTTP/1.1 Aug 12 11:56:23.652169 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 11:56:23.652169 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 11:56:23.652169 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 11:56:23.652169 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 0 Aug 12 11:56:23.652169 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 11:56:23.652169 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 11:56:23.652169 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 11:56:23.652169 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 11:56:23.652169 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9j5kEfCG-tN23X5w95jn5XkxY3U52DBZ_L0GWoiLWEQzz0WA1BQNDsRTE3earO4rAPrqKy1dBuauP7vnvmUsePhyoKYr-NZgS8VVgWSrEJOc5HIRc9IfmS1urw91oJ3OfbkuwhHgYd8t1t_4wf68AVsAUxRV-GI2tagS77oP14cAJ8U Aug 12 11:56:23.652169 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 11:56:23.652169 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 11:56:23.652169 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 11:56:23.652169 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 11:56:23.652169 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 11:56:23.652169 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 11:56:23.652169 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: ecebdd96e25642468903a1657a8ee82d Aug 12 11:56:23.652169 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-AttachVolumeTestJSON-265366964 Aug 12 11:56:23.652169 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 11:56:23.652169 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 11:56:23.653702 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ecebdd96e25642468903a1657a8ee82d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ecebdd96e25642468903a1657a8ee82d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ecebdd96e25642468903a1657a8ee82d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ecebdd96e25642468903a1657a8ee82d"}]}] Aug 12 11:56:23.653702 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-AttachVolumeTestJSON-265366964 Aug 12 11:56:23.653702 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: ecebdd96e25642468903a1657a8ee82d Aug 12 11:56:23.653702 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-AttachVolumeTestJSON-265366964 Aug 12 11:56:23.653702 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-AttachVolumeTestJSON-265366964-project Aug 12 11:56:23.653702 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 11:56:23.653702 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 11:56:23.653702 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: 381f8ca947954e01b6255626d4a2888f Aug 12 11:56:23.653702 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-AttachVolumeTestJSON-265366964-project Aug 12 11:56:23.653702 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: > Aug 12 11:56:23.653702 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Instance 6dba7589-a4cf-4842-953b-0218eae4d3db could not be found. Aug 12 11:56:23.653702 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'id': '6dba7589-a4cf-4842-953b-0218eae4d3db'} Aug 12 11:56:23.657565 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:56:23.657565 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:23.657565 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:56:23.657565 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:56:23.657565 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:56:23.657565 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:56:23.657565 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:56:23.657565 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:56:23.657565 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:56:23.657565 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:56:23.657565 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dba7589-a4cf-4842-953b-0218eae4d3db could not be found. Aug 12 11:56:23.657565 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.657565 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:23.657565 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.657565 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:23.657565 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:23.657565 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:23.657565 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:56:23.657565 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:56:23.657565 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:56:23.659210 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:56:23.659210 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 11:56:23.659210 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 11:56:23.659210 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 11:56:23.659210 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 11:56:23.659210 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:56:23.659210 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:56:23.659210 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:56:23.659210 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:56:23.659210 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dba7589-a4cf-4842-953b-0218eae4d3db could not be found. Aug 12 11:56:23.659210 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.659210 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:23.659210 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.659210 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:23.659210 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:23.659210 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:23.659210 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:56:23.659210 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:56:23.659210 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dba7589-a4cf-4842-953b-0218eae4d3db could not be found. Aug 12 11:56:23.659210 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.660895 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-43658254-5517-4cba-8d91-7f954fbf9701 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Returning 404 to user: Instance 6dba7589-a4cf-4842-953b-0218eae4d3db could not be found. {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:56:23.660895 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-43658254-5517-4cba-8d91-7f954fbf9701 tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 404 len: 111 microversion: 2.1 time: 0.034800 Aug 12 11:56:23.660895 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 437/869] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Aug 12 11:56:23 2022] DELETE /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:56:23.662251 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-764fdbdf-f42f-4134-af56-eb9006e04b1f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:23.662835 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-764fdbdf-f42f-4134-af56-eb9006e04b1f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] [instance: 6dba7589-a4cf-4842-953b-0218eae4d3db] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:23.669226 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-764fdbdf-f42f-4134-af56-eb9006e04b1f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:23.669703 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-764fdbdf-f42f-4134-af56-eb9006e04b1f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:23.670134 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-764fdbdf-f42f-4134-af56-eb9006e04b1f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:23.670876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-764fdbdf-f42f-4134-af56-eb9006e04b1f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:23.671328 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-764fdbdf-f42f-4134-af56-eb9006e04b1f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:23.671749 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-764fdbdf-f42f-4134-af56-eb9006e04b1f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:23.687213 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.wsgi [None req-764fdbdf-f42f-4134-af56-eb9006e04b1f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] HTTP exception thrown: Instance 6dba7589-a4cf-4842-953b-0218eae4d3db could not be found. Aug 12 11:56:23.688752 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-764fdbdf-f42f-4134-af56-eb9006e04b1f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Request method failure captured: Aug 12 11:56:23.688752 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db HTTP/1.1 Aug 12 11:56:23.688752 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 11:56:23.688752 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 11:56:23.688752 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 11:56:23.688752 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 0 Aug 12 11:56:23.688752 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 11:56:23.688752 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 11:56:23.688752 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 11:56:23.688752 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 11:56:23.688752 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9j5kEfCG-tN23X5w95jn5XkxY3U52DBZ_L0GWoiLWEQzz0WA1BQNDsRTE3earO4rAPrqKy1dBuauP7vnvmUsePhyoKYr-NZgS8VVgWSrEJOc5HIRc9IfmS1urw91oJ3OfbkuwhHgYd8t1t_4wf68AVsAUxRV-GI2tagS77oP14cAJ8U Aug 12 11:56:23.688752 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 11:56:23.688752 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 11:56:23.688752 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 11:56:23.688752 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 11:56:23.688752 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 11:56:23.688752 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 11:56:23.688752 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: ecebdd96e25642468903a1657a8ee82d Aug 12 11:56:23.688752 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-AttachVolumeTestJSON-265366964 Aug 12 11:56:23.688752 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 11:56:23.688752 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 11:56:23.690057 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ecebdd96e25642468903a1657a8ee82d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ecebdd96e25642468903a1657a8ee82d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ecebdd96e25642468903a1657a8ee82d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ecebdd96e25642468903a1657a8ee82d"}]}] Aug 12 11:56:23.690057 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-AttachVolumeTestJSON-265366964 Aug 12 11:56:23.690057 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: ecebdd96e25642468903a1657a8ee82d Aug 12 11:56:23.690057 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-AttachVolumeTestJSON-265366964 Aug 12 11:56:23.690057 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-AttachVolumeTestJSON-265366964-project Aug 12 11:56:23.690057 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 11:56:23.690057 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 11:56:23.690057 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: 381f8ca947954e01b6255626d4a2888f Aug 12 11:56:23.690057 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-AttachVolumeTestJSON-265366964-project Aug 12 11:56:23.690057 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: > Aug 12 11:56:23.690057 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Instance 6dba7589-a4cf-4842-953b-0218eae4d3db could not be found. Aug 12 11:56:23.690057 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'id': '6dba7589-a4cf-4842-953b-0218eae4d3db'} Aug 12 11:56:23.690860 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:56:23.690860 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:23.690860 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:56:23.690860 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:56:23.690860 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:56:23.690860 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:56:23.690860 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:56:23.690860 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:56:23.690860 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:56:23.690860 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:56:23.690860 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dba7589-a4cf-4842-953b-0218eae4d3db could not be found. Aug 12 11:56:23.690860 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.690860 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:23.690860 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.690860 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:23.690860 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:23.690860 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:23.690860 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:56:23.690860 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:56:23.690860 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:56:23.692793 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:56:23.692793 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:56:23.692793 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:56:23.692793 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:56:23.692793 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:56:23.692793 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:56:23.692793 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:56:23.692793 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dba7589-a4cf-4842-953b-0218eae4d3db could not be found. Aug 12 11:56:23.692793 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.692793 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:23.692793 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.692793 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:23.692793 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:23.692793 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:23.692793 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:56:23.692793 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:56:23.692793 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dba7589-a4cf-4842-953b-0218eae4d3db could not be found. Aug 12 11:56:23.692793 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:23.693983 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-764fdbdf-f42f-4134-af56-eb9006e04b1f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] Returning 404 to user: Instance 6dba7589-a4cf-4842-953b-0218eae4d3db could not be found. {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:56:23.693983 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-764fdbdf-f42f-4134-af56-eb9006e04b1f tempest-AttachVolumeTestJSON-265366964 tempest-AttachVolumeTestJSON-265366964-project] 10.222.0.42 "GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db" status: 404 len: 111 microversion: 2.1 time: 0.032692 Aug 12 11:56:23.693983 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 433/870] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:56:23 2022] GET /compute/v2.1/servers/6dba7589-a4cf-4842-953b-0218eae4d3db => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 11:56:24.337714 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-02486248-d1ad-4b3c-9bd4-d654de6240b3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:24.338217 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-02486248-d1ad-4b3c-9bd4-d654de6240b3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:24.344720 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-02486248-d1ad-4b3c-9bd4-d654de6240b3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:24.345311 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-02486248-d1ad-4b3c-9bd4-d654de6240b3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:24.345733 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-02486248-d1ad-4b3c-9bd4-d654de6240b3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:24.346428 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-02486248-d1ad-4b3c-9bd4-d654de6240b3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:24.346904 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-02486248-d1ad-4b3c-9bd4-d654de6240b3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:24.347977 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-02486248-d1ad-4b3c-9bd4-d654de6240b3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:24.361725 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.wsgi [None req-02486248-d1ad-4b3c-9bd4-d654de6240b3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] HTTP exception thrown: Instance d4ed98fc-5acc-42ec-9b95-86fc33117c65 could not be found. Aug 12 11:56:24.363318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-02486248-d1ad-4b3c-9bd4-d654de6240b3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Request method failure captured: Aug 12 11:56:24.363318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: DELETE /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 HTTP/1.1 Aug 12 11:56:24.363318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 11:56:24.363318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 11:56:24.363318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 11:56:24.363318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 0 Aug 12 11:56:24.363318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 11:56:24.363318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 11:56:24.363318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 11:56:24.363318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 11:56:24.363318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9j5b93D9DFn6geUGIXSqCWNPRsOoFCQh7K0YJu6U1z8M-82hV_MMW-0Rx_RsrS3lVH4yCHqvGV-EIGSy6uHXvN26xND935rxaQQze8S1cibmQ_P5YQQSOUKlcTJjvmH8tXnzK6aYRsotianp-i1gOUOwU_1_GVtqTppajmycDWrHY6k Aug 12 11:56:24.363318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 11:56:24.363318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 11:56:24.363318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 11:56:24.363318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 11:56:24.363318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 11:56:24.363318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 11:56:24.363318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: 8299891a8d134af4be3f84cdc7abec51 Aug 12 11:56:24.363318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:56:24.363318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 11:56:24.363318 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 11:56:24.364865 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8299891a8d134af4be3f84cdc7abec51", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8299891a8d134af4be3f84cdc7abec51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8299891a8d134af4be3f84cdc7abec51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8299891a8d134af4be3f84cdc7abec51"}]}] Aug 12 11:56:24.364865 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:56:24.364865 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: 8299891a8d134af4be3f84cdc7abec51 Aug 12 11:56:24.364865 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:56:24.364865 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-AttachVolumeNegativeTest-1716385367-project Aug 12 11:56:24.364865 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 11:56:24.364865 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 11:56:24.364865 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: 72a30400dec14a85889af8d8dd59886e Aug 12 11:56:24.364865 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-AttachVolumeNegativeTest-1716385367-project Aug 12 11:56:24.364865 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: > Aug 12 11:56:24.364865 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Instance d4ed98fc-5acc-42ec-9b95-86fc33117c65 could not be found. Aug 12 11:56:24.364865 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'id': 'd4ed98fc-5acc-42ec-9b95-86fc33117c65'} Aug 12 11:56:24.365794 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:56:24.365794 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:24.365794 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:56:24.365794 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:56:24.365794 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:56:24.365794 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:56:24.365794 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:56:24.365794 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:56:24.365794 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:56:24.365794 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:56:24.365794 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4ed98fc-5acc-42ec-9b95-86fc33117c65 could not be found. Aug 12 11:56:24.365794 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:24.365794 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:24.365794 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:24.365794 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:24.365794 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:24.365794 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:24.365794 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:56:24.365794 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:56:24.365794 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:56:24.367389 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:56:24.367389 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 11:56:24.367389 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 11:56:24.367389 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 11:56:24.367389 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 11:56:24.367389 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:56:24.367389 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:56:24.367389 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:56:24.367389 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:56:24.367389 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4ed98fc-5acc-42ec-9b95-86fc33117c65 could not be found. Aug 12 11:56:24.367389 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:24.367389 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:24.367389 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:24.367389 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:24.367389 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:24.367389 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:24.367389 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:56:24.367389 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:56:24.367389 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4ed98fc-5acc-42ec-9b95-86fc33117c65 could not be found. Aug 12 11:56:24.367389 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:24.369399 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-02486248-d1ad-4b3c-9bd4-d654de6240b3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Returning 404 to user: Instance d4ed98fc-5acc-42ec-9b95-86fc33117c65 could not be found. {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:56:24.369399 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-02486248-d1ad-4b3c-9bd4-d654de6240b3 tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 404 len: 111 microversion: 2.1 time: 0.030878 Aug 12 11:56:24.369399 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 438/871] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Aug 12 11:56:24 2022] DELETE /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:56:24.373093 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-5b828221-5c55-42a1-a322-6e65715bf9ce tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:24.373687 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-5b828221-5c55-42a1-a322-6e65715bf9ce tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] [instance: d4ed98fc-5acc-42ec-9b95-86fc33117c65] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:24.379930 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5b828221-5c55-42a1-a322-6e65715bf9ce tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:24.380411 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5b828221-5c55-42a1-a322-6e65715bf9ce tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:24.380849 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5b828221-5c55-42a1-a322-6e65715bf9ce tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:24.381538 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5b828221-5c55-42a1-a322-6e65715bf9ce tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:24.381993 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5b828221-5c55-42a1-a322-6e65715bf9ce tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:24.382418 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5b828221-5c55-42a1-a322-6e65715bf9ce tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:24.396013 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.wsgi [None req-5b828221-5c55-42a1-a322-6e65715bf9ce tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] HTTP exception thrown: Instance d4ed98fc-5acc-42ec-9b95-86fc33117c65 could not be found. Aug 12 11:56:24.397548 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-5b828221-5c55-42a1-a322-6e65715bf9ce tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Request method failure captured: Aug 12 11:56:24.397548 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 HTTP/1.1 Aug 12 11:56:24.397548 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 11:56:24.397548 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 11:56:24.397548 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 11:56:24.397548 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 0 Aug 12 11:56:24.397548 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 11:56:24.397548 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 11:56:24.397548 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 11:56:24.397548 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 11:56:24.397548 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9j5b93D9DFn6geUGIXSqCWNPRsOoFCQh7K0YJu6U1z8M-82hV_MMW-0Rx_RsrS3lVH4yCHqvGV-EIGSy6uHXvN26xND935rxaQQze8S1cibmQ_P5YQQSOUKlcTJjvmH8tXnzK6aYRsotianp-i1gOUOwU_1_GVtqTppajmycDWrHY6k Aug 12 11:56:24.397548 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 11:56:24.397548 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 11:56:24.397548 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 11:56:24.397548 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 11:56:24.397548 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 11:56:24.397548 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 11:56:24.397548 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: 8299891a8d134af4be3f84cdc7abec51 Aug 12 11:56:24.397548 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:56:24.397548 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 11:56:24.397548 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 11:56:24.399911 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8299891a8d134af4be3f84cdc7abec51", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8299891a8d134af4be3f84cdc7abec51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8299891a8d134af4be3f84cdc7abec51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8299891a8d134af4be3f84cdc7abec51"}]}] Aug 12 11:56:24.399911 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:56:24.399911 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: 8299891a8d134af4be3f84cdc7abec51 Aug 12 11:56:24.399911 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716385367 Aug 12 11:56:24.399911 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-AttachVolumeNegativeTest-1716385367-project Aug 12 11:56:24.399911 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 11:56:24.399911 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 11:56:24.399911 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: 72a30400dec14a85889af8d8dd59886e Aug 12 11:56:24.399911 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-AttachVolumeNegativeTest-1716385367-project Aug 12 11:56:24.399911 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: > Aug 12 11:56:24.399911 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Instance d4ed98fc-5acc-42ec-9b95-86fc33117c65 could not be found. Aug 12 11:56:24.399911 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'id': 'd4ed98fc-5acc-42ec-9b95-86fc33117c65'} Aug 12 11:56:24.400781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:56:24.400781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:24.400781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:56:24.400781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:56:24.400781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:56:24.400781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:56:24.400781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:56:24.400781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:56:24.400781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:56:24.400781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:56:24.400781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4ed98fc-5acc-42ec-9b95-86fc33117c65 could not be found. Aug 12 11:56:24.400781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:24.400781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:24.400781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:24.400781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:24.400781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:24.400781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:24.400781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:56:24.400781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:56:24.400781 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:56:24.402060 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:56:24.402060 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:56:24.402060 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:56:24.402060 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:56:24.402060 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:56:24.402060 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:56:24.402060 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:56:24.402060 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4ed98fc-5acc-42ec-9b95-86fc33117c65 could not be found. Aug 12 11:56:24.402060 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:24.402060 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:24.402060 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:24.402060 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:24.402060 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:24.402060 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:24.402060 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:56:24.402060 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:56:24.402060 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4ed98fc-5acc-42ec-9b95-86fc33117c65 could not be found. Aug 12 11:56:24.402060 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:24.403396 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-5b828221-5c55-42a1-a322-6e65715bf9ce tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] Returning 404 to user: Instance d4ed98fc-5acc-42ec-9b95-86fc33117c65 could not be found. {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:56:24.403396 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-5b828221-5c55-42a1-a322-6e65715bf9ce tempest-AttachVolumeNegativeTest-1716385367 tempest-AttachVolumeNegativeTest-1716385367-project] 10.222.0.42 "GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65" status: 404 len: 111 microversion: 2.1 time: 0.029639 Aug 12 11:56:24.403396 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 434/872] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:56:24 2022] GET /compute/v2.1/servers/d4ed98fc-5acc-42ec-9b95-86fc33117c65 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:56:32.186014 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-ecca6503-e807-4678-8d83-54532a0e8747 tempest-VolumesTestJSON-1579104663 tempest-VolumesTestJSON-1579104663-project] Calling method '.version_select at 0x7f3e58180280>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:32.241552 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-ecca6503-e807-4678-8d83-54532a0e8747 tempest-VolumesTestJSON-1579104663 tempest-VolumesTestJSON-1579104663-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/2e705dd6-2973-48dc-9491-34e0c47365ce" status: 200 len: 351 microversion: 2.1 time: 0.060205 Aug 12 11:56:32.242266 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 439/873] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Aug 12 11:56:32 2022] GET /compute/v2.1/os-volumes/2e705dd6-2973-48dc-9491-34e0c47365ce => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:56:33.602235 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-7b3fba11-39d4-4998-977f-57109ff1561a tempest-VolumesTestJSON-1579104663 tempest-VolumesTestJSON-1579104663-project] Calling method '.version_select at 0x7f3e5822d550>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:33.649739 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-7b3fba11-39d4-4998-977f-57109ff1561a tempest-VolumesTestJSON-1579104663 tempest-VolumesTestJSON-1579104663-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/c4dd38be-a3a7-42c3-8fe2-68001190c96a" status: 200 len: 350 microversion: 2.1 time: 0.051185 Aug 12 11:56:33.650293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 435/874] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Aug 12 11:56:33 2022] GET /compute/v2.1/os-volumes/c4dd38be-a3a7-42c3-8fe2-68001190c96a => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:56:33.829869 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-df74c84f-9a26-4bfd-ab02-8360faf619be tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1367443721", "imageRef": "2887ca5b-6aa2-4cc4-a2be-9322a733fc6d", "flavorRef": "452", "networks": [{"uuid": "ba0b2159-a508-4567-ae56-4128aa55964d"}]}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:56:33.895553 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.network.neutron [None req-df74c84f-9a26-4bfd-ab02-8360faf619be tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] validate_networks() for [('ba0b2159-a508-4567-ae56-4128aa55964d', None, None, None, None, None)] {{(pid=132281) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 11:56:34.286908 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-df74c84f-9a26-4bfd-ab02-8360faf619be tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Flavor limits 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 11:56:34.287527 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-df74c84f-9a26-4bfd-ab02-8360faf619be tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Image limits 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 11:56:34.288109 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-df74c84f-9a26-4bfd-ab02-8360faf619be tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Flavor pref 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 11:56:34.288643 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-df74c84f-9a26-4bfd-ab02-8360faf619be tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Image pref 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 11:56:34.289055 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-df74c84f-9a26-4bfd-ab02-8360faf619be tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 11:56:34.297796 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-df74c84f-9a26-4bfd-ab02-8360faf619be tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:34.298269 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-df74c84f-9a26-4bfd-ab02-8360faf619be tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:34.298730 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-df74c84f-9a26-4bfd-ab02-8360faf619be tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:34.299447 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-df74c84f-9a26-4bfd-ab02-8360faf619be tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:34.299979 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-df74c84f-9a26-4bfd-ab02-8360faf619be tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:34.301097 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-df74c84f-9a26-4bfd-ab02-8360faf619be tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:34.320326 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.quota [None req-df74c84f-9a26-4bfd-ab02-8360faf619be tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Getting quotas for project 8c66a0584e9345c392d95524bdcc7f16. Resources: {'instances', 'ram', 'cores'} {{(pid=132281) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:56:34.325021 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.quota [None req-df74c84f-9a26-4bfd-ab02-8360faf619be tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Getting quotas for user 10ddb84a8b734c70b7b55685a1a12f95 and project 8c66a0584e9345c392d95524bdcc7f16. Resources: {'instances', 'ram', 'cores'} {{(pid=132281) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:56:34.336112 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-df74c84f-9a26-4bfd-ab02-8360faf619be tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Going to run 1 instances... {{(pid=132281) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 11:56:34.338393 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-df74c84f-9a26-4bfd-ab02-8360faf619be tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: de11929c-e125-4e21-b5b1-1cd777200e4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2887ca5b-6aa2-4cc4-a2be-9322a733fc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132281) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 11:56:34.391481 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-df74c84f-9a26-4bfd-ab02-8360faf619be tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.565918 Aug 12 11:56:34.392458 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 440/875] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Aug 12 11:56:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 11:56:34.399614 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:34.400455 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:34.404928 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e1731030-8274-4f6c-aab7-b92365cccb7b tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:34.405728 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-e1731030-8274-4f6c-aab7-b92365cccb7b tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: de11929c-e125-4e21-b5b1-1cd777200e4c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:34.479182 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e1731030-8274-4f6c-aab7-b92365cccb7b tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:34.485730 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e1731030-8274-4f6c-aab7-b92365cccb7b tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c" status: 200 len: 1219 microversion: 2.1 time: 0.086984 Aug 12 11:56:34.486277 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 436/876] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:56:34 2022] GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:56:34.995121 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-89b8ab19-bde8-4e5d-90ee-5414b8995cb5 tempest-VolumesTestJSON-1579104663 tempest-VolumesTestJSON-1579104663-project] Calling method '.version_select at 0x7f3e58180280>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:35.047333 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-89b8ab19-bde8-4e5d-90ee-5414b8995cb5 tempest-VolumesTestJSON-1579104663 tempest-VolumesTestJSON-1579104663-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7e00b994-ef8e-4b68-a6c7-4fb5a40a313e" status: 200 len: 350 microversion: 2.1 time: 0.056053 Aug 12 11:56:35.047895 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 441/877] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Aug 12 11:56:34 2022] GET /compute/v2.1/os-volumes/7e00b994-ef8e-4b68-a6c7-4fb5a40a313e => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:56:35.060233 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-9eabf41e-ca3e-4cc9-8f70-288a8d410e99 tempest-VolumesTestJSON-1579104663 tempest-VolumesTestJSON-1579104663-project] Calling method '.version_select at 0x7f3e58262e50>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:35.144347 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-9eabf41e-ca3e-4cc9-8f70-288a8d410e99 tempest-VolumesTestJSON-1579104663 tempest-VolumesTestJSON-1579104663-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.087867 Aug 12 11:56:35.144942 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 437/878] 10.222.0.42 () {58 vars in 1134 bytes} [Fri Aug 12 11:56:35 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:56:35.158693 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-37595913-1fd2-46ba-9f10-383ea9815ceb tempest-VolumesTestJSON-1579104663 tempest-VolumesTestJSON-1579104663-project] Calling method '.version_select at 0x7f3e58218670>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:35.240221 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-37595913-1fd2-46ba-9f10-383ea9815ceb tempest-VolumesTestJSON-1579104663 tempest-VolumesTestJSON-1579104663-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.085225 Aug 12 11:56:35.240771 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 442/879] 10.222.0.42 () {58 vars in 1149 bytes} [Fri Aug 12 11:56:35 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:56:35.253980 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-86a76844-4791-4c4b-bdcf-4722dbedf7ff tempest-VolumesTestJSON-1579104663 tempest-VolumesTestJSON-1579104663-project] Calling method '.version_select at 0x7f3e5caf60d0>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:35.334047 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-86a76844-4791-4c4b-bdcf-4722dbedf7ff tempest-VolumesTestJSON-1579104663 tempest-VolumesTestJSON-1579104663-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.084210 Aug 12 11:56:35.334777 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 438/880] 10.222.0.42 () {58 vars in 1134 bytes} [Fri Aug 12 11:56:35 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:56:35.347332 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-1701481b-d6a1-40df-9f9d-cddd3a803038 tempest-VolumesTestJSON-1579104663 tempest-VolumesTestJSON-1579104663-project] Calling method '.version_select at 0x7f3e58088430>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:35.428676 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-1701481b-d6a1-40df-9f9d-cddd3a803038 tempest-VolumesTestJSON-1579104663 tempest-VolumesTestJSON-1579104663-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085108 Aug 12 11:56:35.429240 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 443/881] 10.222.0.42 () {58 vars in 1167 bytes} [Fri Aug 12 11:56:35 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:56:35.442932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-c978c682-d98d-4795-908e-3a7298d94f74 tempest-VolumesTestJSON-1579104663 tempest-VolumesTestJSON-1579104663-project] Calling method '.version_select at 0x7f3e58216dc0>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:35.507970 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-66bfe417-4b1e-403c-9475-21f694c556a4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:35.508816 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-66bfe417-4b1e-403c-9475-21f694c556a4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: de11929c-e125-4e21-b5b1-1cd777200e4c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:35.521065 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-66bfe417-4b1e-403c-9475-21f694c556a4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:35.521636 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-66bfe417-4b1e-403c-9475-21f694c556a4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:35.522246 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-66bfe417-4b1e-403c-9475-21f694c556a4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:35.522989 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-66bfe417-4b1e-403c-9475-21f694c556a4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:35.523625 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-66bfe417-4b1e-403c-9475-21f694c556a4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:35.524233 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-66bfe417-4b1e-403c-9475-21f694c556a4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:35.548932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-c978c682-d98d-4795-908e-3a7298d94f74 tempest-VolumesTestJSON-1579104663 tempest-VolumesTestJSON-1579104663-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.110379 Aug 12 11:56:35.549493 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 439/882] 10.222.0.42 () {58 vars in 1170 bytes} [Fri Aug 12 11:56:35 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:56:35.563582 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-c2868b27-b81d-458b-a177-4a6881ec926d tempest-VolumesTestJSON-1579104663 tempest-VolumesTestJSON-1579104663-project] Calling method '.version_select at 0x7f3e58285ca0>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:35.618191 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-66bfe417-4b1e-403c-9475-21f694c556a4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:35.631395 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-66bfe417-4b1e-403c-9475-21f694c556a4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c" status: 200 len: 1289 microversion: 2.1 time: 0.127396 Aug 12 11:56:35.640713 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 444/883] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:56:35 2022] GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c => generated 1289 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:56:35.672558 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-c2868b27-b81d-458b-a177-4a6881ec926d tempest-VolumesTestJSON-1579104663 tempest-VolumesTestJSON-1579104663-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.113020 Aug 12 11:56:35.673114 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 440/884] 10.222.0.42 () {58 vars in 1155 bytes} [Fri Aug 12 11:56:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:56:35.687526 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e83c1e81-894f-4d30-8410-8c940e88f804 tempest-VolumesTestJSON-1579104663 tempest-VolumesTestJSON-1579104663-project] Calling method '.version_select at 0x7f3e5803ca60>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:35.777097 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-e83c1e81-894f-4d30-8410-8c940e88f804 tempest-VolumesTestJSON-1579104663 tempest-VolumesTestJSON-1579104663-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.094140 Aug 12 11:56:35.777661 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 445/885] 10.222.0.42 () {58 vars in 1188 bytes} [Fri Aug 12 11:56:35 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:56:35.790866 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-8c865d60-4eec-4cb2-8052-86cfe57b144e tempest-VolumesTestJSON-1579104663 tempest-VolumesTestJSON-1579104663-project] Calling method '.version_select at 0x7f3e58216f70>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:35.879800 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-8c865d60-4eec-4cb2-8052-86cfe57b144e tempest-VolumesTestJSON-1579104663 tempest-VolumesTestJSON-1579104663-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.092572 Aug 12 11:56:35.880444 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 441/886] 10.222.0.42 () {58 vars in 1155 bytes} [Fri Aug 12 11:56:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:56:36.662467 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-ad6ef540-9dc7-4963-81de-c8aca4a297fa tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:36.664000 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-ad6ef540-9dc7-4963-81de-c8aca4a297fa tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: de11929c-e125-4e21-b5b1-1cd777200e4c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:36.671845 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ad6ef540-9dc7-4963-81de-c8aca4a297fa tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:36.672330 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ad6ef540-9dc7-4963-81de-c8aca4a297fa tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:36.672760 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ad6ef540-9dc7-4963-81de-c8aca4a297fa tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:36.673476 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ad6ef540-9dc7-4963-81de-c8aca4a297fa tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:36.673925 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ad6ef540-9dc7-4963-81de-c8aca4a297fa tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:36.674341 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ad6ef540-9dc7-4963-81de-c8aca4a297fa tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:36.876326 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-ad6ef540-9dc7-4963-81de-c8aca4a297fa tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:36.883725 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-ad6ef540-9dc7-4963-81de-c8aca4a297fa tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c" status: 200 len: 1319 microversion: 2.1 time: 0.226233 Aug 12 11:56:36.884506 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 446/887] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:56:36 2022] GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:56:36.964159 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-6f639313-7a3f-4074-b294-4f1dd9a5b585 req-07ce4ea2-ff2a-405a-b006-ae043b20cc68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de11929c-e125-4e21-b5b1-1cd777200e4c", "tag": "8f57f664-cc1c-4b51-b503-85f993f78c79"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:56:36.975228 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-6f639313-7a3f-4074-b294-4f1dd9a5b585 req-07ce4ea2-ff2a-405a-b006-ae043b20cc68 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:36.975706 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-6f639313-7a3f-4074-b294-4f1dd9a5b585 req-07ce4ea2-ff2a-405a-b006-ae043b20cc68 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:36.976153 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-6f639313-7a3f-4074-b294-4f1dd9a5b585 req-07ce4ea2-ff2a-405a-b006-ae043b20cc68 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:36.986456 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-6f639313-7a3f-4074-b294-4f1dd9a5b585 req-07ce4ea2-ff2a-405a-b006-ae043b20cc68 service nova] Creating event network-changed:8f57f664-cc1c-4b51-b503-85f993f78c79 for instance de11929c-e125-4e21-b5b1-1cd777200e4c on hv-cinder-85282 Aug 12 11:56:36.991548 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-6f639313-7a3f-4074-b294-4f1dd9a5b585 req-07ce4ea2-ff2a-405a-b006-ae043b20cc68 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031632 Aug 12 11:56:36.992128 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 442/888] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:56:37.905409 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-ebbf48e5-67ce-462b-97b5-07ae12ebe548 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:37.906015 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-ebbf48e5-67ce-462b-97b5-07ae12ebe548 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: de11929c-e125-4e21-b5b1-1cd777200e4c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:37.912445 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ebbf48e5-67ce-462b-97b5-07ae12ebe548 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:37.912924 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ebbf48e5-67ce-462b-97b5-07ae12ebe548 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:37.913355 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ebbf48e5-67ce-462b-97b5-07ae12ebe548 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:37.914039 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ebbf48e5-67ce-462b-97b5-07ae12ebe548 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:37.914488 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ebbf48e5-67ce-462b-97b5-07ae12ebe548 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:37.914935 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ebbf48e5-67ce-462b-97b5-07ae12ebe548 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:38.042466 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-ebbf48e5-67ce-462b-97b5-07ae12ebe548 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:38.051170 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-ebbf48e5-67ce-462b-97b5-07ae12ebe548 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c" status: 200 len: 1319 microversion: 2.1 time: 0.149112 Aug 12 11:56:38.051729 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 447/889] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:56:37 2022] GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:56:39.073698 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-baffd0ae-1cc4-41c6-886e-e7acf84a6172 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:39.074535 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-baffd0ae-1cc4-41c6-886e-e7acf84a6172 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: de11929c-e125-4e21-b5b1-1cd777200e4c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:39.080839 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-baffd0ae-1cc4-41c6-886e-e7acf84a6172 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:39.081853 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-baffd0ae-1cc4-41c6-886e-e7acf84a6172 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:39.082294 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-baffd0ae-1cc4-41c6-886e-e7acf84a6172 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:39.083012 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-baffd0ae-1cc4-41c6-886e-e7acf84a6172 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:39.083471 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-baffd0ae-1cc4-41c6-886e-e7acf84a6172 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:39.083899 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-baffd0ae-1cc4-41c6-886e-e7acf84a6172 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:39.216421 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-baffd0ae-1cc4-41c6-886e-e7acf84a6172 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:39.224521 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-baffd0ae-1cc4-41c6-886e-e7acf84a6172 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c" status: 200 len: 1319 microversion: 2.1 time: 0.155403 Aug 12 11:56:39.224998 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 443/890] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:56:39 2022] GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:56:40.245733 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-433331dd-a04d-4cd7-bdb9-3092c8da759a tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:40.246355 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-433331dd-a04d-4cd7-bdb9-3092c8da759a tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: de11929c-e125-4e21-b5b1-1cd777200e4c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:40.252830 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-433331dd-a04d-4cd7-bdb9-3092c8da759a tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:40.253341 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-433331dd-a04d-4cd7-bdb9-3092c8da759a tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:40.253774 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-433331dd-a04d-4cd7-bdb9-3092c8da759a tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:40.254463 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-433331dd-a04d-4cd7-bdb9-3092c8da759a tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:40.254985 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-433331dd-a04d-4cd7-bdb9-3092c8da759a tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:40.255409 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-433331dd-a04d-4cd7-bdb9-3092c8da759a tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:40.387634 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-433331dd-a04d-4cd7-bdb9-3092c8da759a tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:40.395026 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-433331dd-a04d-4cd7-bdb9-3092c8da759a tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c" status: 200 len: 1319 microversion: 2.1 time: 0.153670 Aug 12 11:56:40.395580 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 448/891] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:56:40 2022] GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:56:41.372632 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-5a3878ee-7f3d-48f8-a5cb-17bbc018ac77 req-32d95b71-a83f-451e-9248-0f10072884b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de11929c-e125-4e21-b5b1-1cd777200e4c", "name": "network-vif-plugged", "status": "completed", "tag": "8f57f664-cc1c-4b51-b503-85f993f78c79"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:56:41.386144 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-5a3878ee-7f3d-48f8-a5cb-17bbc018ac77 req-32d95b71-a83f-451e-9248-0f10072884b2 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:41.386639 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-5a3878ee-7f3d-48f8-a5cb-17bbc018ac77 req-32d95b71-a83f-451e-9248-0f10072884b2 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:41.387092 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-5a3878ee-7f3d-48f8-a5cb-17bbc018ac77 req-32d95b71-a83f-451e-9248-0f10072884b2 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:41.400137 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-5a3878ee-7f3d-48f8-a5cb-17bbc018ac77 req-32d95b71-a83f-451e-9248-0f10072884b2 service nova] Creating event network-vif-plugged:8f57f664-cc1c-4b51-b503-85f993f78c79 for instance de11929c-e125-4e21-b5b1-1cd777200e4c on hv-cinder-85282 Aug 12 11:56:41.406139 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-5a3878ee-7f3d-48f8-a5cb-17bbc018ac77 req-32d95b71-a83f-451e-9248-0f10072884b2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041133 Aug 12 11:56:41.407089 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 444/892] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:56:41.417616 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-72b5e386-7df6-4a42-adb1-3da8ced0a193 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:41.419799 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-72b5e386-7df6-4a42-adb1-3da8ced0a193 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: de11929c-e125-4e21-b5b1-1cd777200e4c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:41.428705 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-72b5e386-7df6-4a42-adb1-3da8ced0a193 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:41.429636 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-72b5e386-7df6-4a42-adb1-3da8ced0a193 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:41.430235 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-72b5e386-7df6-4a42-adb1-3da8ced0a193 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:41.431720 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-72b5e386-7df6-4a42-adb1-3da8ced0a193 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:41.432354 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-72b5e386-7df6-4a42-adb1-3da8ced0a193 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:41.432781 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-72b5e386-7df6-4a42-adb1-3da8ced0a193 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:41.601872 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-72b5e386-7df6-4a42-adb1-3da8ced0a193 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:41.610335 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-72b5e386-7df6-4a42-adb1-3da8ced0a193 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c" status: 200 len: 1319 microversion: 2.1 time: 0.197987 Aug 12 11:56:41.610942 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 449/893] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:56:41 2022] GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:56:42.634283 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-f74c1295-8abd-4c30-a614-b03f14184ea7 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:42.635020 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-f74c1295-8abd-4c30-a614-b03f14184ea7 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: de11929c-e125-4e21-b5b1-1cd777200e4c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:42.641100 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f74c1295-8abd-4c30-a614-b03f14184ea7 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:42.641574 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f74c1295-8abd-4c30-a614-b03f14184ea7 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:42.642003 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f74c1295-8abd-4c30-a614-b03f14184ea7 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:42.642715 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f74c1295-8abd-4c30-a614-b03f14184ea7 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:42.643164 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f74c1295-8abd-4c30-a614-b03f14184ea7 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:42.643583 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f74c1295-8abd-4c30-a614-b03f14184ea7 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:42.777123 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-f74c1295-8abd-4c30-a614-b03f14184ea7 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:42.786263 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-f74c1295-8abd-4c30-a614-b03f14184ea7 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c" status: 200 len: 1319 microversion: 2.1 time: 0.157109 Aug 12 11:56:42.788849 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 445/894] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:56:42 2022] GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:56:43.810570 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-7ad54fa9-4049-4840-872e-1ad395c26e4a tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:43.811212 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-7ad54fa9-4049-4840-872e-1ad395c26e4a tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: de11929c-e125-4e21-b5b1-1cd777200e4c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:43.818715 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7ad54fa9-4049-4840-872e-1ad395c26e4a tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:43.819205 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7ad54fa9-4049-4840-872e-1ad395c26e4a tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:43.819643 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7ad54fa9-4049-4840-872e-1ad395c26e4a tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:43.820337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7ad54fa9-4049-4840-872e-1ad395c26e4a tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:43.820792 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7ad54fa9-4049-4840-872e-1ad395c26e4a tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:43.821218 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7ad54fa9-4049-4840-872e-1ad395c26e4a tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:43.950541 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-7ad54fa9-4049-4840-872e-1ad395c26e4a tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:43.958219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-7ad54fa9-4049-4840-872e-1ad395c26e4a tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c" status: 200 len: 1507 microversion: 2.1 time: 0.152232 Aug 12 11:56:43.958808 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 450/895] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:56:43 2022] GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:56:45.604317 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-97c46bc4-fea4-4430-bb0f-ba4a89f18e1c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:45.607128 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-97c46bc4-fea4-4430-bb0f-ba4a89f18e1c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:45.616360 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=2 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:45.619405 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-97c46bc4-fea4-4430-bb0f-ba4a89f18e1c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:45.620146 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-97c46bc4-fea4-4430-bb0f-ba4a89f18e1c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:45.621562 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-97c46bc4-fea4-4430-bb0f-ba4a89f18e1c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:45.623266 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-97c46bc4-fea4-4430-bb0f-ba4a89f18e1c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:45.623869 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-97c46bc4-fea4-4430-bb0f-ba4a89f18e1c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:45.624740 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-97c46bc4-fea4-4430-bb0f-ba4a89f18e1c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:45.668565 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-97c46bc4-fea4-4430-bb0f-ba4a89f18e1c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.069380 Aug 12 11:56:45.669160 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 446/896] 10.222.0.42 () {60 vars in 1343 bytes} [Fri Aug 12 11:56:45 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:56:45.730383 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-8251d5b0-1c52-4276-a247-7eb669b8c353 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:45.730896 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-8251d5b0-1c52-4276-a247-7eb669b8c353 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:45.732983 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell0:SELECT=2 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:45.733765 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell0:SELECT=6 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:45.741412 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8251d5b0-1c52-4276-a247-7eb669b8c353 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:45.741902 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8251d5b0-1c52-4276-a247-7eb669b8c353 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:45.742342 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8251d5b0-1c52-4276-a247-7eb669b8c353 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:45.743081 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8251d5b0-1c52-4276-a247-7eb669b8c353 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:45.743539 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8251d5b0-1c52-4276-a247-7eb669b8c353 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:45.743965 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-8251d5b0-1c52-4276-a247-7eb669b8c353 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:45.771505 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-8251d5b0-1c52-4276-a247-7eb669b8c353 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Going to try to terminate instance {{(pid=132281) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 11:56:45.854972 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-8251d5b0-1c52-4276-a247-7eb669b8c353 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "DELETE /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 204 len: 0 microversion: 2.20 time: 0.128075 Aug 12 11:56:45.858746 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 451/897] 10.222.0.42 () {60 vars in 1280 bytes} [Fri Aug 12 11:56:45 2022] DELETE /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 12 11:56:45.864998 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-7420a9fe-08be-4776-8032-20da0ff2da72 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:45.865744 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-7420a9fe-08be-4776-8032-20da0ff2da72 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:45.872360 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7420a9fe-08be-4776-8032-20da0ff2da72 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:45.872851 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7420a9fe-08be-4776-8032-20da0ff2da72 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:45.873290 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7420a9fe-08be-4776-8032-20da0ff2da72 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:45.873990 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7420a9fe-08be-4776-8032-20da0ff2da72 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:45.874439 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7420a9fe-08be-4776-8032-20da0ff2da72 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:45.874885 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7420a9fe-08be-4776-8032-20da0ff2da72 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:46.014313 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-7420a9fe-08be-4776-8032-20da0ff2da72 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:46.022954 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-7420a9fe-08be-4776-8032-20da0ff2da72 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:46.024464 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-7420a9fe-08be-4776-8032-20da0ff2da72 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:46.025698 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-7420a9fe-08be-4776-8032-20da0ff2da72 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1724 microversion: 2.20 time: 0.165690 Aug 12 11:56:46.026245 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 447/898] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:56:45 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:56:47.053061 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-a01666aa-d6ea-45cd-a959-cff294de3803 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:47.053823 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-a01666aa-d6ea-45cd-a959-cff294de3803 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:47.056878 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:47.063003 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a01666aa-d6ea-45cd-a959-cff294de3803 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:47.063485 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a01666aa-d6ea-45cd-a959-cff294de3803 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:47.064096 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a01666aa-d6ea-45cd-a959-cff294de3803 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:47.064797 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a01666aa-d6ea-45cd-a959-cff294de3803 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:47.065257 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a01666aa-d6ea-45cd-a959-cff294de3803 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:47.065702 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a01666aa-d6ea-45cd-a959-cff294de3803 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:47.068921 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:47.226048 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-a01666aa-d6ea-45cd-a959-cff294de3803 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:47.238094 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-a01666aa-d6ea-45cd-a959-cff294de3803 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:47.239610 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-a01666aa-d6ea-45cd-a959-cff294de3803 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:47.241177 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-a01666aa-d6ea-45cd-a959-cff294de3803 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1724 microversion: 2.20 time: 0.194833 Aug 12 11:56:47.242010 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 452/899] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:56:47 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 11:56:48.264123 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-cffc3d40-5242-46d5-b824-a048e610374c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:48.265512 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-cffc3d40-5242-46d5-b824-a048e610374c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:48.276248 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cffc3d40-5242-46d5-b824-a048e610374c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:48.277006 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cffc3d40-5242-46d5-b824-a048e610374c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:48.277934 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cffc3d40-5242-46d5-b824-a048e610374c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:48.279809 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cffc3d40-5242-46d5-b824-a048e610374c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:48.281080 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cffc3d40-5242-46d5-b824-a048e610374c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:48.281520 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-cffc3d40-5242-46d5-b824-a048e610374c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:48.373862 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-cffc3d40-5242-46d5-b824-a048e610374c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:48.390830 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-cffc3d40-5242-46d5-b824-a048e610374c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:48.392779 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-cffc3d40-5242-46d5-b824-a048e610374c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d02a90e6cb7428985fe399974b385b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34010de730e4448288baf7e944d52cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:56:48.394431 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-cffc3d40-5242-46d5-b824-a048e610374c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 200 len: 1657 microversion: 2.20 time: 0.134149 Aug 12 11:56:48.395472 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 448/900] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:56:48 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 1657 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 11:56:48.598087 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-9f9ffe47-e48c-4fcb-b378-14783dc2e129 req-652cce4e-46a5-4c47-bd5d-c28a107ef488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766f6d20-8985-4a72-b2d7-4062c001c834", "name": "network-vif-deleted", "tag": "9f04531c-9036-4a8c-96e9-678608518051"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:56:48.629952 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-9f9ffe47-e48c-4fcb-b378-14783dc2e129 req-652cce4e-46a5-4c47-bd5d-c28a107ef488 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:48.631041 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-9f9ffe47-e48c-4fcb-b378-14783dc2e129 req-652cce4e-46a5-4c47-bd5d-c28a107ef488 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:48.632174 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-9f9ffe47-e48c-4fcb-b378-14783dc2e129 req-652cce4e-46a5-4c47-bd5d-c28a107ef488 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:48.656303 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-9f9ffe47-e48c-4fcb-b378-14783dc2e129 req-652cce4e-46a5-4c47-bd5d-c28a107ef488 service nova] Creating event network-vif-deleted:9f04531c-9036-4a8c-96e9-678608518051 for instance 766f6d20-8985-4a72-b2d7-4062c001c834 on hv-cinder-85282 Aug 12 11:56:48.662602 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-9f9ffe47-e48c-4fcb-b378-14783dc2e129 req-652cce4e-46a5-4c47-bd5d-c28a107ef488 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074704 Aug 12 11:56:48.675644 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 453/901] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:56:49.420278 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d2791c5a-b89d-44c4-aaa4-555f36e99d2c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:49.421021 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d2791c5a-b89d-44c4-aaa4-555f36e99d2c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:49.436045 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d2791c5a-b89d-44c4-aaa4-555f36e99d2c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:49.436643 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d2791c5a-b89d-44c4-aaa4-555f36e99d2c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:49.437471 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d2791c5a-b89d-44c4-aaa4-555f36e99d2c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:49.438237 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d2791c5a-b89d-44c4-aaa4-555f36e99d2c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:49.438999 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d2791c5a-b89d-44c4-aaa4-555f36e99d2c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:49.443876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d2791c5a-b89d-44c4-aaa4-555f36e99d2c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:49.459121 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.wsgi [None req-d2791c5a-b89d-44c4-aaa4-555f36e99d2c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] HTTP exception thrown: Instance 766f6d20-8985-4a72-b2d7-4062c001c834 could not be found. Aug 12 11:56:49.460877 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d2791c5a-b89d-44c4-aaa4-555f36e99d2c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Request method failure captured: Aug 12 11:56:49.460877 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 HTTP/1.1 Aug 12 11:56:49.460877 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 11:56:49.460877 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 11:56:49.460877 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 11:56:49.460877 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 0 Aug 12 11:56:49.460877 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 11:56:49.460877 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 11:56:49.460877 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 11:56:49.460877 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 11:56:49.460877 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9j5d3bsL9h8VyUoZAxGHLHkHNUioAqmnqDFdF4BmFvpJij50HpEhqoeOfQLVTDBD7wrHpnf_hetPyZyJymqbBPyyArpCWmTwVEpc5CwTRxVHEvEkaTxVf2I6RLHSslWk7Dc-nTsZDSGsflAdDk_n8g5eDlIWmv4QDZNHAcZT3PqyNtI Aug 12 11:56:49.460877 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 11:56:49.460877 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 11:56:49.460877 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 11:56:49.460877 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 11:56:49.460877 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 11:56:49.460877 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 11:56:49.460877 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 11:56:49.460877 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: 34010de730e4448288baf7e944d52cf9 Aug 12 11:56:49.460877 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1240343559 Aug 12 11:56:49.460877 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 11:56:49.460877 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 11:56:49.462720 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_34010de730e4448288baf7e944d52cf9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/34010de730e4448288baf7e944d52cf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34010de730e4448288baf7e944d52cf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34010de730e4448288baf7e944d52cf9"}]}] Aug 12 11:56:49.462720 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1240343559 Aug 12 11:56:49.462720 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: 34010de730e4448288baf7e944d52cf9 Aug 12 11:56:49.462720 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1240343559 Aug 12 11:56:49.462720 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-AttachVolumeShelveTestJSON-1240343559-project Aug 12 11:56:49.462720 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 11:56:49.462720 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 11:56:49.462720 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: 7d02a90e6cb7428985fe399974b385b9 Aug 12 11:56:49.462720 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1240343559-project Aug 12 11:56:49.462720 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: > Aug 12 11:56:49.462720 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Instance 766f6d20-8985-4a72-b2d7-4062c001c834 could not be found. Aug 12 11:56:49.462720 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'id': '766f6d20-8985-4a72-b2d7-4062c001c834'} Aug 12 11:56:49.463670 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:56:49.463670 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:49.463670 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:56:49.463670 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:56:49.463670 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:56:49.463670 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:56:49.463670 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:56:49.463670 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:56:49.463670 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:56:49.463670 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:56:49.463670 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 766f6d20-8985-4a72-b2d7-4062c001c834 could not be found. Aug 12 11:56:49.463670 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:49.463670 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:49.463670 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:49.463670 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:49.463670 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:49.463670 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:49.463670 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:56:49.463670 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:56:49.463670 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:56:49.465267 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:56:49.465267 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:56:49.465267 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:56:49.465267 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:56:49.465267 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:56:49.465267 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:56:49.465267 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:56:49.465267 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 766f6d20-8985-4a72-b2d7-4062c001c834 could not be found. Aug 12 11:56:49.465267 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:49.465267 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:49.465267 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:49.465267 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:49.465267 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:49.465267 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:49.465267 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:56:49.465267 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:56:49.465267 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 766f6d20-8985-4a72-b2d7-4062c001c834 could not be found. Aug 12 11:56:49.465267 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:49.467073 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d2791c5a-b89d-44c4-aaa4-555f36e99d2c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Returning 404 to user: Instance 766f6d20-8985-4a72-b2d7-4062c001c834 could not be found. {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:56:49.467073 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-d2791c5a-b89d-44c4-aaa4-555f36e99d2c tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 404 len: 111 microversion: 2.20 time: 0.052579 Aug 12 11:56:49.467887 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 449/902] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:56:49 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 12 11:56:49.477458 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-4cc183ec-13b6-41ef-9737-bd24d1d1dc68 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '.version_select at 0x7f3e4bfbbf70>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:49.504396 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-4cc183ec-13b6-41ef-9737-bd24d1d1dc68 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1110829837" status: 204 len: 0 microversion: 2.20 time: 0.028218 Aug 12 11:56:49.506023 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 454/903] 10.222.0.42 () {60 vars in 1262 bytes} [Fri Aug 12 11:56:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1110829837 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 12 11:56:51.507342 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-800d1ab4-7668-4422-8ff5-7d20eb5424f0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:51.507943 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-800d1ab4-7668-4422-8ff5-7d20eb5424f0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:51.517203 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-800d1ab4-7668-4422-8ff5-7d20eb5424f0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:51.517689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-800d1ab4-7668-4422-8ff5-7d20eb5424f0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:51.518175 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-800d1ab4-7668-4422-8ff5-7d20eb5424f0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:51.519497 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-800d1ab4-7668-4422-8ff5-7d20eb5424f0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:51.519954 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-800d1ab4-7668-4422-8ff5-7d20eb5424f0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:51.520384 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-800d1ab4-7668-4422-8ff5-7d20eb5424f0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:51.535555 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.wsgi [None req-800d1ab4-7668-4422-8ff5-7d20eb5424f0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] HTTP exception thrown: Instance 766f6d20-8985-4a72-b2d7-4062c001c834 could not be found. Aug 12 11:56:51.537133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-800d1ab4-7668-4422-8ff5-7d20eb5424f0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Request method failure captured: Aug 12 11:56:51.537133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: DELETE /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 HTTP/1.1 Aug 12 11:56:51.537133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 11:56:51.537133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 11:56:51.537133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 11:56:51.537133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 0 Aug 12 11:56:51.537133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 11:56:51.537133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 11:56:51.537133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 11:56:51.537133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 11:56:51.537133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9j5d3bsL9h8VyUoZAxGHLHkHNUioAqmnqDFdF4BmFvpJij50HpEhqoeOfQLVTDBD7wrHpnf_hetPyZyJymqbBPyyArpCWmTwVEpc5CwTRxVHEvEkaTxVf2I6RLHSslWk7Dc-nTsZDSGsflAdDk_n8g5eDlIWmv4QDZNHAcZT3PqyNtI Aug 12 11:56:51.537133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 11:56:51.537133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 11:56:51.537133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 11:56:51.537133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 11:56:51.537133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 11:56:51.537133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 11:56:51.537133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 11:56:51.537133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: 34010de730e4448288baf7e944d52cf9 Aug 12 11:56:51.537133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1240343559 Aug 12 11:56:51.537133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 11:56:51.537133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 11:56:51.538811 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_34010de730e4448288baf7e944d52cf9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/34010de730e4448288baf7e944d52cf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34010de730e4448288baf7e944d52cf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34010de730e4448288baf7e944d52cf9"}]}] Aug 12 11:56:51.538811 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1240343559 Aug 12 11:56:51.538811 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: 34010de730e4448288baf7e944d52cf9 Aug 12 11:56:51.538811 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1240343559 Aug 12 11:56:51.538811 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-AttachVolumeShelveTestJSON-1240343559-project Aug 12 11:56:51.538811 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 11:56:51.538811 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 11:56:51.538811 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: 7d02a90e6cb7428985fe399974b385b9 Aug 12 11:56:51.538811 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1240343559-project Aug 12 11:56:51.538811 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: > Aug 12 11:56:51.538811 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Instance 766f6d20-8985-4a72-b2d7-4062c001c834 could not be found. Aug 12 11:56:51.538811 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'id': '766f6d20-8985-4a72-b2d7-4062c001c834'} Aug 12 11:56:51.539682 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:56:51.539682 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:51.539682 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:56:51.539682 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:56:51.539682 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:56:51.539682 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:56:51.539682 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:56:51.539682 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:56:51.539682 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:56:51.539682 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:56:51.539682 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 766f6d20-8985-4a72-b2d7-4062c001c834 could not be found. Aug 12 11:56:51.539682 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:51.539682 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:51.539682 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:51.539682 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:51.539682 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:51.539682 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:51.539682 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:56:51.539682 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:56:51.539682 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:56:51.541094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:56:51.541094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 11:56:51.541094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 11:56:51.541094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 11:56:51.541094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 11:56:51.541094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:56:51.541094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:56:51.541094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:56:51.541094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:56:51.541094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 766f6d20-8985-4a72-b2d7-4062c001c834 could not be found. Aug 12 11:56:51.541094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:51.541094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:51.541094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:51.541094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:51.541094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:51.541094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:51.541094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:56:51.541094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:56:51.541094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 766f6d20-8985-4a72-b2d7-4062c001c834 could not be found. Aug 12 11:56:51.541094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:51.543483 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-800d1ab4-7668-4422-8ff5-7d20eb5424f0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Returning 404 to user: Instance 766f6d20-8985-4a72-b2d7-4062c001c834 could not be found. {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:56:51.544335 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-800d1ab4-7668-4422-8ff5-7d20eb5424f0 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "DELETE /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 404 len: 111 microversion: 2.20 time: 0.041518 Aug 12 11:56:51.544868 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 450/904] 10.222.0.42 () {60 vars in 1280 bytes} [Fri Aug 12 11:56:51 2022] DELETE /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 12 11:56:51.557324 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-6b9770a3-4c39-4b25-9282-325356923230 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:51.563248 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-6b9770a3-4c39-4b25-9282-325356923230 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 766f6d20-8985-4a72-b2d7-4062c001c834] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:51.571137 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6b9770a3-4c39-4b25-9282-325356923230 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:51.571636 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6b9770a3-4c39-4b25-9282-325356923230 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:51.572420 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6b9770a3-4c39-4b25-9282-325356923230 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:51.573275 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6b9770a3-4c39-4b25-9282-325356923230 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:51.573717 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6b9770a3-4c39-4b25-9282-325356923230 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:51.574141 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6b9770a3-4c39-4b25-9282-325356923230 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:51.592557 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.wsgi [None req-6b9770a3-4c39-4b25-9282-325356923230 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] HTTP exception thrown: Instance 766f6d20-8985-4a72-b2d7-4062c001c834 could not be found. Aug 12 11:56:51.594640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-6b9770a3-4c39-4b25-9282-325356923230 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Request method failure captured: Aug 12 11:56:51.594640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 HTTP/1.1 Aug 12 11:56:51.594640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 11:56:51.594640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 11:56:51.594640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 11:56:51.594640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 0 Aug 12 11:56:51.594640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 11:56:51.594640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 11:56:51.594640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 11:56:51.594640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 11:56:51.594640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9j5d3bsL9h8VyUoZAxGHLHkHNUioAqmnqDFdF4BmFvpJij50HpEhqoeOfQLVTDBD7wrHpnf_hetPyZyJymqbBPyyArpCWmTwVEpc5CwTRxVHEvEkaTxVf2I6RLHSslWk7Dc-nTsZDSGsflAdDk_n8g5eDlIWmv4QDZNHAcZT3PqyNtI Aug 12 11:56:51.594640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 11:56:51.594640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 11:56:51.594640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 11:56:51.594640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 11:56:51.594640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 11:56:51.594640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 11:56:51.594640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 11:56:51.594640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: 34010de730e4448288baf7e944d52cf9 Aug 12 11:56:51.594640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1240343559 Aug 12 11:56:51.594640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 11:56:51.594640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 11:56:51.596249 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_34010de730e4448288baf7e944d52cf9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/34010de730e4448288baf7e944d52cf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34010de730e4448288baf7e944d52cf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34010de730e4448288baf7e944d52cf9"}]}] Aug 12 11:56:51.596249 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1240343559 Aug 12 11:56:51.596249 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: 34010de730e4448288baf7e944d52cf9 Aug 12 11:56:51.596249 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1240343559 Aug 12 11:56:51.596249 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-AttachVolumeShelveTestJSON-1240343559-project Aug 12 11:56:51.596249 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 11:56:51.596249 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 11:56:51.596249 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: 7d02a90e6cb7428985fe399974b385b9 Aug 12 11:56:51.596249 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1240343559-project Aug 12 11:56:51.596249 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: > Aug 12 11:56:51.596249 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Instance 766f6d20-8985-4a72-b2d7-4062c001c834 could not be found. Aug 12 11:56:51.596249 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'id': '766f6d20-8985-4a72-b2d7-4062c001c834'} Aug 12 11:56:51.597278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:56:51.597278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:51.597278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:56:51.597278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:56:51.597278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:56:51.597278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:56:51.597278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:56:51.597278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:56:51.597278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:56:51.597278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:56:51.597278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 766f6d20-8985-4a72-b2d7-4062c001c834 could not be found. Aug 12 11:56:51.597278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:51.597278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:51.597278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:51.597278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:51.597278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:51.597278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:51.597278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:56:51.597278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:56:51.597278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:56:51.598828 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:56:51.598828 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:56:51.598828 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:56:51.598828 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:56:51.598828 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:56:51.598828 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:56:51.598828 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:56:51.598828 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 766f6d20-8985-4a72-b2d7-4062c001c834 could not be found. Aug 12 11:56:51.598828 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:51.598828 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:51.598828 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:51.598828 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:51.598828 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:51.598828 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:51.598828 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:56:51.598828 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:56:51.598828 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 766f6d20-8985-4a72-b2d7-4062c001c834 could not be found. Aug 12 11:56:51.598828 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:51.600748 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-6b9770a3-4c39-4b25-9282-325356923230 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Returning 404 to user: Instance 766f6d20-8985-4a72-b2d7-4062c001c834 could not be found. {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:56:51.601767 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-6b9770a3-4c39-4b25-9282-325356923230 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834" status: 404 len: 111 microversion: 2.20 time: 0.051410 Aug 12 11:56:51.602320 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 455/905] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:56:51 2022] GET /compute/v2.1/servers/766f6d20-8985-4a72-b2d7-4062c001c834 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 12 11:56:52.763583 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-2396d1e2-0ff1-40cb-a64a-b1e6493111d2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:52.764205 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-2396d1e2-0ff1-40cb-a64a-b1e6493111d2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:52.771089 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2396d1e2-0ff1-40cb-a64a-b1e6493111d2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:52.771650 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2396d1e2-0ff1-40cb-a64a-b1e6493111d2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:52.772160 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2396d1e2-0ff1-40cb-a64a-b1e6493111d2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:52.772932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2396d1e2-0ff1-40cb-a64a-b1e6493111d2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:52.773565 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2396d1e2-0ff1-40cb-a64a-b1e6493111d2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:52.773969 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2396d1e2-0ff1-40cb-a64a-b1e6493111d2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:52.787669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.wsgi [None req-2396d1e2-0ff1-40cb-a64a-b1e6493111d2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] HTTP exception thrown: Instance 712bb3a1-789a-442f-8d59-a635f0896531 could not be found. Aug 12 11:56:52.789252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-2396d1e2-0ff1-40cb-a64a-b1e6493111d2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Request method failure captured: Aug 12 11:56:52.789252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: DELETE /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 HTTP/1.1 Aug 12 11:56:52.789252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 11:56:52.789252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 11:56:52.789252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 11:56:52.789252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 0 Aug 12 11:56:52.789252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 11:56:52.789252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 11:56:52.789252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 11:56:52.789252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 11:56:52.789252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9j5d3bsL9h8VyUoZAxGHLHkHNUioAqmnqDFdF4BmFvpJij50HpEhqoeOfQLVTDBD7wrHpnf_hetPyZyJymqbBPyyArpCWmTwVEpc5CwTRxVHEvEkaTxVf2I6RLHSslWk7Dc-nTsZDSGsflAdDk_n8g5eDlIWmv4QDZNHAcZT3PqyNtI Aug 12 11:56:52.789252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 11:56:52.789252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 11:56:52.789252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 11:56:52.789252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 11:56:52.789252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 11:56:52.789252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 11:56:52.789252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 11:56:52.789252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: 34010de730e4448288baf7e944d52cf9 Aug 12 11:56:52.789252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1240343559 Aug 12 11:56:52.789252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 11:56:52.789252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 11:56:52.790884 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_34010de730e4448288baf7e944d52cf9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/34010de730e4448288baf7e944d52cf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34010de730e4448288baf7e944d52cf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34010de730e4448288baf7e944d52cf9"}]}] Aug 12 11:56:52.790884 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1240343559 Aug 12 11:56:52.790884 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: 34010de730e4448288baf7e944d52cf9 Aug 12 11:56:52.790884 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1240343559 Aug 12 11:56:52.790884 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-AttachVolumeShelveTestJSON-1240343559-project Aug 12 11:56:52.790884 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 11:56:52.790884 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 11:56:52.790884 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: 7d02a90e6cb7428985fe399974b385b9 Aug 12 11:56:52.790884 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1240343559-project Aug 12 11:56:52.790884 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: > Aug 12 11:56:52.790884 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Instance 712bb3a1-789a-442f-8d59-a635f0896531 could not be found. Aug 12 11:56:52.790884 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'id': '712bb3a1-789a-442f-8d59-a635f0896531'} Aug 12 11:56:52.792067 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:56:52.792067 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:52.792067 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:56:52.792067 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:56:52.792067 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:56:52.792067 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:56:52.792067 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:56:52.792067 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:56:52.792067 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:56:52.792067 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:56:52.792067 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 712bb3a1-789a-442f-8d59-a635f0896531 could not be found. Aug 12 11:56:52.792067 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:52.792067 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:52.792067 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:52.792067 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:52.792067 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:52.792067 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:52.792067 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:56:52.792067 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:56:52.792067 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:56:52.793507 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:56:52.793507 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 11:56:52.793507 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 11:56:52.793507 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 11:56:52.793507 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 11:56:52.793507 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:56:52.793507 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:56:52.793507 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:56:52.793507 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:56:52.793507 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 712bb3a1-789a-442f-8d59-a635f0896531 could not be found. Aug 12 11:56:52.793507 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:52.793507 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:52.793507 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:52.793507 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:52.793507 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:52.793507 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:52.793507 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:56:52.793507 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:56:52.793507 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 712bb3a1-789a-442f-8d59-a635f0896531 could not be found. Aug 12 11:56:52.793507 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:56:52.795168 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-2396d1e2-0ff1-40cb-a64a-b1e6493111d2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Returning 404 to user: Instance 712bb3a1-789a-442f-8d59-a635f0896531 could not be found. {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:56:52.795168 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-2396d1e2-0ff1-40cb-a64a-b1e6493111d2 tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "DELETE /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 404 len: 111 microversion: 2.20 time: 0.031100 Aug 12 11:56:52.795168 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 451/906] 10.222.0.42 () {60 vars in 1280 bytes} [Fri Aug 12 11:56:52 2022] DELETE /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 12 11:56:52.799180 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-61e2df97-e4fb-44d9-8bd0-ece9b61577ba tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:56:52.799625 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-61e2df97-e4fb-44d9-8bd0-ece9b61577ba tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] [instance: 712bb3a1-789a-442f-8d59-a635f0896531] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:56:52.807578 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-61e2df97-e4fb-44d9-8bd0-ece9b61577ba tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:52.808068 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-61e2df97-e4fb-44d9-8bd0-ece9b61577ba tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:52.808501 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-61e2df97-e4fb-44d9-8bd0-ece9b61577ba tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:52.809664 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-61e2df97-e4fb-44d9-8bd0-ece9b61577ba tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:56:52.810299 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-61e2df97-e4fb-44d9-8bd0-ece9b61577ba tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:56:52.810934 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-61e2df97-e4fb-44d9-8bd0-ece9b61577ba tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:56:52.826367 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.wsgi [None req-61e2df97-e4fb-44d9-8bd0-ece9b61577ba tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] HTTP exception thrown: Instance 712bb3a1-789a-442f-8d59-a635f0896531 could not be found. Aug 12 11:56:52.828443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-61e2df97-e4fb-44d9-8bd0-ece9b61577ba tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Request method failure captured: Aug 12 11:56:52.828443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 HTTP/1.1 Aug 12 11:56:52.828443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 11:56:52.828443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 11:56:52.828443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 11:56:52.828443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 0 Aug 12 11:56:52.828443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 11:56:52.828443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 11:56:52.828443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 11:56:52.828443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 11:56:52.828443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9j5d3bsL9h8VyUoZAxGHLHkHNUioAqmnqDFdF4BmFvpJij50HpEhqoeOfQLVTDBD7wrHpnf_hetPyZyJymqbBPyyArpCWmTwVEpc5CwTRxVHEvEkaTxVf2I6RLHSslWk7Dc-nTsZDSGsflAdDk_n8g5eDlIWmv4QDZNHAcZT3PqyNtI Aug 12 11:56:52.828443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 11:56:52.828443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 11:56:52.828443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 11:56:52.828443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 11:56:52.828443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 11:56:52.828443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 11:56:52.828443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 11:56:52.828443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: 34010de730e4448288baf7e944d52cf9 Aug 12 11:56:52.828443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1240343559 Aug 12 11:56:52.828443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 11:56:52.828443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 11:56:52.829824 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_34010de730e4448288baf7e944d52cf9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/34010de730e4448288baf7e944d52cf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34010de730e4448288baf7e944d52cf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34010de730e4448288baf7e944d52cf9"}]}] Aug 12 11:56:52.829824 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1240343559 Aug 12 11:56:52.829824 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: 34010de730e4448288baf7e944d52cf9 Aug 12 11:56:52.829824 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1240343559 Aug 12 11:56:52.829824 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-AttachVolumeShelveTestJSON-1240343559-project Aug 12 11:56:52.829824 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 11:56:52.829824 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 11:56:52.829824 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: 7d02a90e6cb7428985fe399974b385b9 Aug 12 11:56:52.829824 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1240343559-project Aug 12 11:56:52.829824 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: > Aug 12 11:56:52.829824 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Instance 712bb3a1-789a-442f-8d59-a635f0896531 could not be found. Aug 12 11:56:52.829824 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'id': '712bb3a1-789a-442f-8d59-a635f0896531'} Aug 12 11:56:52.830564 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:56:52.830564 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:52.830564 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:56:52.830564 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:56:52.830564 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:56:52.830564 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:56:52.830564 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:56:52.830564 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:56:52.830564 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:56:52.830564 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:56:52.830564 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 712bb3a1-789a-442f-8d59-a635f0896531 could not be found. Aug 12 11:56:52.830564 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:52.830564 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:52.830564 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:52.830564 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:52.830564 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:52.830564 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:52.830564 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:56:52.830564 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:56:52.830564 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:56:52.832154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:56:52.832154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:56:52.832154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:56:52.832154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:56:52.832154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:56:52.832154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:56:52.832154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:56:52.832154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 712bb3a1-789a-442f-8d59-a635f0896531 could not be found. Aug 12 11:56:52.832154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:52.832154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:56:52.832154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:52.832154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:56:52.832154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:56:52.832154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:56:52.832154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:56:52.832154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:56:52.832154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 712bb3a1-789a-442f-8d59-a635f0896531 could not be found. Aug 12 11:56:52.832154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:56:52.834317 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-61e2df97-e4fb-44d9-8bd0-ece9b61577ba tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] Returning 404 to user: Instance 712bb3a1-789a-442f-8d59-a635f0896531 could not be found. {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:56:52.835357 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-61e2df97-e4fb-44d9-8bd0-ece9b61577ba tempest-AttachVolumeShelveTestJSON-1240343559 tempest-AttachVolumeShelveTestJSON-1240343559-project] 10.222.0.42 "GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531" status: 404 len: 111 microversion: 2.20 time: 0.040099 Aug 12 11:56:52.835926 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 456/907] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Aug 12 11:56:52 2022] GET /compute/v2.1/servers/712bb3a1-789a-442f-8d59-a635f0896531 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 12 11:57:01.507929 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-a8899f34-8fa9-463a-bc80-49f9a1059532 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-263914439", "imageRef": "2887ca5b-6aa2-4cc4-a2be-9322a733fc6d", "flavorRef": "452", "networks": [{"uuid": "c572b318-b1f8-4da9-bbc9-3d1444c7f138"}]}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:57:01.519834 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-aa57f13d-800a-45c9-9c4b-694661568375 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5062ced-3485-4275-8816-b9ba342c7490", "device": "/dev/sdb"}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:57:01.522734 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-aa57f13d-800a-45c9-9c4b-694661568375 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: de11929c-e125-4e21-b5b1-1cd777200e4c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:01.529415 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-aa57f13d-800a-45c9-9c4b-694661568375 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:01.529907 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-aa57f13d-800a-45c9-9c4b-694661568375 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:01.530344 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-aa57f13d-800a-45c9-9c4b-694661568375 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:01.531077 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-aa57f13d-800a-45c9-9c4b-694661568375 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:01.531539 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-aa57f13d-800a-45c9-9c4b-694661568375 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:01.531968 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-aa57f13d-800a-45c9-9c4b-694661568375 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:01.562878 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.network.neutron [None req-a8899f34-8fa9-463a-bc80-49f9a1059532 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] validate_networks() for [('c572b318-b1f8-4da9-bbc9-3d1444c7f138', None, None, None, None, None)] {{(pid=132282) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 11:57:01.797880 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-aa57f13d-800a-45c9-9c4b-694661568375 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "POST /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282453 Aug 12 11:57:01.798513 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 457/908] 10.222.0.42 () {60 vars in 1323 bytes} [Fri Aug 12 11:57:01 2022] POST /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:57:01.934220 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-a8899f34-8fa9-463a-bc80-49f9a1059532 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Flavor limits 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 11:57:01.934669 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-a8899f34-8fa9-463a-bc80-49f9a1059532 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Image limits 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 11:57:01.935148 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-a8899f34-8fa9-463a-bc80-49f9a1059532 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Flavor pref 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 11:57:01.935585 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-a8899f34-8fa9-463a-bc80-49f9a1059532 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Image pref 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 11:57:01.935995 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-a8899f34-8fa9-463a-bc80-49f9a1059532 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 11:57:01.945833 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a8899f34-8fa9-463a-bc80-49f9a1059532 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:01.946313 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a8899f34-8fa9-463a-bc80-49f9a1059532 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:01.946790 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a8899f34-8fa9-463a-bc80-49f9a1059532 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:01.947520 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a8899f34-8fa9-463a-bc80-49f9a1059532 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:01.948001 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a8899f34-8fa9-463a-bc80-49f9a1059532 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:01.948429 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a8899f34-8fa9-463a-bc80-49f9a1059532 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:01.965314 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-a8899f34-8fa9-463a-bc80-49f9a1059532 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Getting quotas for project e5c85fe65feb4b3f890372c8da841629. Resources: {'instances', 'ram', 'cores'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:57:01.969321 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-a8899f34-8fa9-463a-bc80-49f9a1059532 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Getting quotas for user bdbf4f974f1747188e46c85a3601124a and project e5c85fe65feb4b3f890372c8da841629. Resources: {'instances', 'ram', 'cores'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:57:01.980839 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-a8899f34-8fa9-463a-bc80-49f9a1059532 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Going to run 1 instances... {{(pid=132282) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 11:57:01.983036 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-a8899f34-8fa9-463a-bc80-49f9a1059532 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 883ed732-b52e-4ea3-a999-4cda67b267d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2887ca5b-6aa2-4cc4-a2be-9322a733fc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132282) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 11:57:02.029544 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-a8899f34-8fa9-463a-bc80-49f9a1059532 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525686 Aug 12 11:57:02.030168 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 452/909] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Aug 12 11:57:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 11:57:02.042515 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-0050ccdb-9057-46aa-824e-cbd6aa30513b tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:02.043512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-0050ccdb-9057-46aa-824e-cbd6aa30513b tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 883ed732-b52e-4ea3-a999-4cda67b267d2] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:02.101668 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-0050ccdb-9057-46aa-824e-cbd6aa30513b tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:02.108474 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-0050ccdb-9057-46aa-824e-cbd6aa30513b tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2" status: 200 len: 1213 microversion: 2.1 time: 0.070734 Aug 12 11:57:02.109482 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 458/910] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:02 2022] GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2 => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:03.130567 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-42240bdf-c83e-4c90-b204-c19e54a989de tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:03.131929 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-42240bdf-c83e-4c90-b204-c19e54a989de tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 883ed732-b52e-4ea3-a999-4cda67b267d2] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:03.139831 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-42240bdf-c83e-4c90-b204-c19e54a989de tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:03.140544 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-42240bdf-c83e-4c90-b204-c19e54a989de tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:03.141158 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-42240bdf-c83e-4c90-b204-c19e54a989de tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:03.142164 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-42240bdf-c83e-4c90-b204-c19e54a989de tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:03.142799 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-42240bdf-c83e-4c90-b204-c19e54a989de tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:03.143463 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-42240bdf-c83e-4c90-b204-c19e54a989de tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:03.264531 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-42240bdf-c83e-4c90-b204-c19e54a989de tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:03.272077 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-42240bdf-c83e-4c90-b204-c19e54a989de tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2" status: 200 len: 1273 microversion: 2.1 time: 0.146539 Aug 12 11:57:03.272632 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 453/911] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:03 2022] GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2 => generated 1273 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:04.293035 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-70c7219e-4707-4255-9f91-8a92cf91c889 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:04.294290 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-70c7219e-4707-4255-9f91-8a92cf91c889 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 883ed732-b52e-4ea3-a999-4cda67b267d2] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:04.302907 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-70c7219e-4707-4255-9f91-8a92cf91c889 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:04.303761 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-70c7219e-4707-4255-9f91-8a92cf91c889 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:04.304639 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-70c7219e-4707-4255-9f91-8a92cf91c889 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:04.305647 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-70c7219e-4707-4255-9f91-8a92cf91c889 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:04.306451 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-70c7219e-4707-4255-9f91-8a92cf91c889 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:04.307069 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-70c7219e-4707-4255-9f91-8a92cf91c889 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:04.535081 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-70c7219e-4707-4255-9f91-8a92cf91c889 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:04.543438 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-70c7219e-4707-4255-9f91-8a92cf91c889 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2" status: 200 len: 1313 microversion: 2.1 time: 0.254725 Aug 12 11:57:04.544092 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 459/912] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:04 2022] GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2 => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:04.681434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-ddeb97b9-cf42-4302-9f63-993b09363e76 req-05ad07bb-ad2a-4127-af5a-637db9badd0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "883ed732-b52e-4ea3-a999-4cda67b267d2", "tag": "d35e4fcf-a2d6-4b95-b5d7-cbe164c21ab1"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:57:04.692075 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:04.699998 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-ddeb97b9-cf42-4302-9f63-993b09363e76 req-05ad07bb-ad2a-4127-af5a-637db9badd0f service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:04.701712 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-ddeb97b9-cf42-4302-9f63-993b09363e76 req-05ad07bb-ad2a-4127-af5a-637db9badd0f service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:04.703447 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-ddeb97b9-cf42-4302-9f63-993b09363e76 req-05ad07bb-ad2a-4127-af5a-637db9badd0f service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:04.711078 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=49 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:04.734215 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-ddeb97b9-cf42-4302-9f63-993b09363e76 req-05ad07bb-ad2a-4127-af5a-637db9badd0f service nova] Creating event network-changed:d35e4fcf-a2d6-4b95-b5d7-cbe164c21ab1 for instance 883ed732-b52e-4ea3-a999-4cda67b267d2 on hv-cinder-85282 Aug 12 11:57:04.758850 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-ddeb97b9-cf42-4302-9f63-993b09363e76 req-05ad07bb-ad2a-4127-af5a-637db9badd0f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082208 Aug 12 11:57:04.759455 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 454/913] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:57:05.565273 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-2567c1bb-0d9a-48f2-8f42-ac027a5f0c56 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:05.565914 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-2567c1bb-0d9a-48f2-8f42-ac027a5f0c56 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 883ed732-b52e-4ea3-a999-4cda67b267d2] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:05.572540 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2567c1bb-0d9a-48f2-8f42-ac027a5f0c56 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:05.573025 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2567c1bb-0d9a-48f2-8f42-ac027a5f0c56 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:05.573725 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2567c1bb-0d9a-48f2-8f42-ac027a5f0c56 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:05.574662 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2567c1bb-0d9a-48f2-8f42-ac027a5f0c56 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:05.575333 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2567c1bb-0d9a-48f2-8f42-ac027a5f0c56 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:05.575966 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2567c1bb-0d9a-48f2-8f42-ac027a5f0c56 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:05.788810 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-2567c1bb-0d9a-48f2-8f42-ac027a5f0c56 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:05.800932 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-2567c1bb-0d9a-48f2-8f42-ac027a5f0c56 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2" status: 200 len: 1313 microversion: 2.1 time: 0.239576 Aug 12 11:57:05.801821 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 460/914] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:05 2022] GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:06.824629 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-860da6d3-5a3f-435b-93e4-0f13761ed151 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:06.826365 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-860da6d3-5a3f-435b-93e4-0f13761ed151 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 883ed732-b52e-4ea3-a999-4cda67b267d2] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:06.833985 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-860da6d3-5a3f-435b-93e4-0f13761ed151 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:06.834716 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-860da6d3-5a3f-435b-93e4-0f13761ed151 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:06.835156 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-860da6d3-5a3f-435b-93e4-0f13761ed151 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:06.835856 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-860da6d3-5a3f-435b-93e4-0f13761ed151 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:06.836307 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-860da6d3-5a3f-435b-93e4-0f13761ed151 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:06.837002 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-860da6d3-5a3f-435b-93e4-0f13761ed151 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:07.124407 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-860da6d3-5a3f-435b-93e4-0f13761ed151 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:07.135335 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-860da6d3-5a3f-435b-93e4-0f13761ed151 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2" status: 200 len: 1313 microversion: 2.1 time: 0.314226 Aug 12 11:57:07.135906 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 455/915] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:06 2022] GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2 => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:08.158626 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-86cd4a1b-a166-48c9-a4ec-ce59b41ff7ae tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:08.160549 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-86cd4a1b-a166-48c9-a4ec-ce59b41ff7ae tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 883ed732-b52e-4ea3-a999-4cda67b267d2] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:08.166926 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86cd4a1b-a166-48c9-a4ec-ce59b41ff7ae tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:08.167696 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86cd4a1b-a166-48c9-a4ec-ce59b41ff7ae tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:08.167837 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86cd4a1b-a166-48c9-a4ec-ce59b41ff7ae tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:08.168535 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86cd4a1b-a166-48c9-a4ec-ce59b41ff7ae tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:08.169055 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86cd4a1b-a166-48c9-a4ec-ce59b41ff7ae tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:08.169404 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86cd4a1b-a166-48c9-a4ec-ce59b41ff7ae tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:08.302923 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-86cd4a1b-a166-48c9-a4ec-ce59b41ff7ae tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:08.311232 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-86cd4a1b-a166-48c9-a4ec-ce59b41ff7ae tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2" status: 200 len: 1313 microversion: 2.1 time: 0.157234 Aug 12 11:57:08.311761 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 461/916] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:08 2022] GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:09.334223 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d0f979ec-4621-47e2-95d2-fa652ad501ff tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:09.334697 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d0f979ec-4621-47e2-95d2-fa652ad501ff tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 883ed732-b52e-4ea3-a999-4cda67b267d2] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:09.344935 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d0f979ec-4621-47e2-95d2-fa652ad501ff tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:09.345600 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d0f979ec-4621-47e2-95d2-fa652ad501ff tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:09.346203 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d0f979ec-4621-47e2-95d2-fa652ad501ff tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:09.347112 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d0f979ec-4621-47e2-95d2-fa652ad501ff tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:09.347714 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d0f979ec-4621-47e2-95d2-fa652ad501ff tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:09.348346 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d0f979ec-4621-47e2-95d2-fa652ad501ff tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:09.509876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d0f979ec-4621-47e2-95d2-fa652ad501ff tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:09.518491 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-d0f979ec-4621-47e2-95d2-fa652ad501ff tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2" status: 200 len: 1313 microversion: 2.1 time: 0.188713 Aug 12 11:57:09.519911 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 456/917] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:09 2022] GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:09.543167 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-2437c54a-214b-42c5-8f7a-c31324b00138 req-80511c78-e7ba-4cc6-b062-aee0c3e5e584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "883ed732-b52e-4ea3-a999-4cda67b267d2", "name": "network-vif-plugged", "status": "completed", "tag": "d35e4fcf-a2d6-4b95-b5d7-cbe164c21ab1"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:57:09.567206 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-2437c54a-214b-42c5-8f7a-c31324b00138 req-80511c78-e7ba-4cc6-b062-aee0c3e5e584 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:09.567902 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-2437c54a-214b-42c5-8f7a-c31324b00138 req-80511c78-e7ba-4cc6-b062-aee0c3e5e584 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:09.568538 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-2437c54a-214b-42c5-8f7a-c31324b00138 req-80511c78-e7ba-4cc6-b062-aee0c3e5e584 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:09.583340 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-2437c54a-214b-42c5-8f7a-c31324b00138 req-80511c78-e7ba-4cc6-b062-aee0c3e5e584 service nova] Creating event network-vif-plugged:d35e4fcf-a2d6-4b95-b5d7-cbe164c21ab1 for instance 883ed732-b52e-4ea3-a999-4cda67b267d2 on hv-cinder-85282 Aug 12 11:57:09.588610 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-2437c54a-214b-42c5-8f7a-c31324b00138 req-80511c78-e7ba-4cc6-b062-aee0c3e5e584 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049031 Aug 12 11:57:09.589202 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 462/918] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:57:10.541222 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-507a3a86-0796-48e6-ae4e-9d5e58291713 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:10.541829 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-507a3a86-0796-48e6-ae4e-9d5e58291713 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 883ed732-b52e-4ea3-a999-4cda67b267d2] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:10.548152 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-507a3a86-0796-48e6-ae4e-9d5e58291713 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:10.548645 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-507a3a86-0796-48e6-ae4e-9d5e58291713 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:10.549070 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-507a3a86-0796-48e6-ae4e-9d5e58291713 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:10.549749 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-507a3a86-0796-48e6-ae4e-9d5e58291713 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:10.550960 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-507a3a86-0796-48e6-ae4e-9d5e58291713 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:10.551381 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-507a3a86-0796-48e6-ae4e-9d5e58291713 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:10.689430 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-507a3a86-0796-48e6-ae4e-9d5e58291713 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:10.705819 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-507a3a86-0796-48e6-ae4e-9d5e58291713 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2" status: 200 len: 1313 microversion: 2.1 time: 0.168188 Aug 12 11:57:10.707400 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 457/919] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:10 2022] GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:11.728965 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-05e7571e-4c56-481a-8e78-8a8f5f2f3a99 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:11.729614 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-05e7571e-4c56-481a-8e78-8a8f5f2f3a99 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 883ed732-b52e-4ea3-a999-4cda67b267d2] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:11.735716 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-05e7571e-4c56-481a-8e78-8a8f5f2f3a99 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:11.736191 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-05e7571e-4c56-481a-8e78-8a8f5f2f3a99 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:11.736622 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-05e7571e-4c56-481a-8e78-8a8f5f2f3a99 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:11.737908 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-05e7571e-4c56-481a-8e78-8a8f5f2f3a99 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:11.738368 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-05e7571e-4c56-481a-8e78-8a8f5f2f3a99 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:11.738831 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-05e7571e-4c56-481a-8e78-8a8f5f2f3a99 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:11.872290 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-05e7571e-4c56-481a-8e78-8a8f5f2f3a99 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:11.879990 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-05e7571e-4c56-481a-8e78-8a8f5f2f3a99 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2" status: 200 len: 1313 microversion: 2.1 time: 0.155831 Aug 12 11:57:11.880560 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 463/920] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:11 2022] GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:12.900001 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-c90971a8-e7f5-4ead-8d6e-e4d9bc2efc85 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:12.900639 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-c90971a8-e7f5-4ead-8d6e-e4d9bc2efc85 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 883ed732-b52e-4ea3-a999-4cda67b267d2] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:12.903021 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=2 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:12.903678 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=6 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:12.909491 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c90971a8-e7f5-4ead-8d6e-e4d9bc2efc85 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:12.909971 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c90971a8-e7f5-4ead-8d6e-e4d9bc2efc85 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:12.910401 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c90971a8-e7f5-4ead-8d6e-e4d9bc2efc85 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:12.911108 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c90971a8-e7f5-4ead-8d6e-e4d9bc2efc85 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:12.911550 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c90971a8-e7f5-4ead-8d6e-e4d9bc2efc85 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:12.911971 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c90971a8-e7f5-4ead-8d6e-e4d9bc2efc85 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:13.038844 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-c90971a8-e7f5-4ead-8d6e-e4d9bc2efc85 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:13.046243 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-c90971a8-e7f5-4ead-8d6e-e4d9bc2efc85 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2" status: 200 len: 1313 microversion: 2.1 time: 0.149985 Aug 12 11:57:13.046824 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 458/921] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:12 2022] GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:14.068633 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-f39fb489-c514-450e-a7a7-0a5817bb8619 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:14.070458 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-f39fb489-c514-450e-a7a7-0a5817bb8619 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 883ed732-b52e-4ea3-a999-4cda67b267d2] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:14.081833 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell0:SELECT=2 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:14.092773 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f39fb489-c514-450e-a7a7-0a5817bb8619 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:14.093518 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f39fb489-c514-450e-a7a7-0a5817bb8619 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:14.093978 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f39fb489-c514-450e-a7a7-0a5817bb8619 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:14.096206 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f39fb489-c514-450e-a7a7-0a5817bb8619 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:14.096702 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f39fb489-c514-450e-a7a7-0a5817bb8619 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:14.097168 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f39fb489-c514-450e-a7a7-0a5817bb8619 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:14.247346 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-f39fb489-c514-450e-a7a7-0a5817bb8619 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:14.256817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-f39fb489-c514-450e-a7a7-0a5817bb8619 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2" status: 200 len: 1497 microversion: 2.1 time: 0.192335 Aug 12 11:57:14.257172 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 464/922] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:14 2022] GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2 => generated 1497 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:17.522298 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d47eac99-5a15-4e44-9264-5a4161a853e9 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:17.522841 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d47eac99-5a15-4e44-9264-5a4161a853e9 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 883ed732-b52e-4ea3-a999-4cda67b267d2] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:17.529164 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d47eac99-5a15-4e44-9264-5a4161a853e9 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:17.529646 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d47eac99-5a15-4e44-9264-5a4161a853e9 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:17.530077 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d47eac99-5a15-4e44-9264-5a4161a853e9 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:17.530801 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d47eac99-5a15-4e44-9264-5a4161a853e9 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:17.531256 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d47eac99-5a15-4e44-9264-5a4161a853e9 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:17.531679 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d47eac99-5a15-4e44-9264-5a4161a853e9 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:17.556358 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d47eac99-5a15-4e44-9264-5a4161a853e9 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 883ed732-b52e-4ea3-a999-4cda67b267d2] Going to try to terminate instance {{(pid=132282) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 11:57:17.633947 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-d47eac99-5a15-4e44-9264-5a4161a853e9 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "DELETE /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2" status: 204 len: 0 microversion: 2.1 time: 0.115099 Aug 12 11:57:17.638159 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 459/923] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Aug 12 11:57:17 2022] DELETE /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 11:57:17.643557 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-14bf218f-4df2-41ed-bbd3-69b8ba20778f tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:17.644178 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-14bf218f-4df2-41ed-bbd3-69b8ba20778f tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 883ed732-b52e-4ea3-a999-4cda67b267d2] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:17.646843 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:17.655079 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-14bf218f-4df2-41ed-bbd3-69b8ba20778f tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:17.655236 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-14bf218f-4df2-41ed-bbd3-69b8ba20778f tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:17.655673 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-14bf218f-4df2-41ed-bbd3-69b8ba20778f tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:17.656380 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-14bf218f-4df2-41ed-bbd3-69b8ba20778f tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:17.656844 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-14bf218f-4df2-41ed-bbd3-69b8ba20778f tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:17.657306 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-14bf218f-4df2-41ed-bbd3-69b8ba20778f tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:17.661139 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:17.799463 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-14bf218f-4df2-41ed-bbd3-69b8ba20778f tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:17.807814 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-14bf218f-4df2-41ed-bbd3-69b8ba20778f tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2" status: 200 len: 1503 microversion: 2.1 time: 0.168191 Aug 12 11:57:17.808374 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 465/924] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:17 2022] GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2 => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:18.829842 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-2a790285-8333-44ef-ad06-974aa96f80ac tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:18.830544 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-2a790285-8333-44ef-ad06-974aa96f80ac tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 883ed732-b52e-4ea3-a999-4cda67b267d2] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:18.837434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2a790285-8333-44ef-ad06-974aa96f80ac tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:18.837917 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2a790285-8333-44ef-ad06-974aa96f80ac tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:18.838352 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2a790285-8333-44ef-ad06-974aa96f80ac tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:18.839061 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2a790285-8333-44ef-ad06-974aa96f80ac tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:18.839515 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2a790285-8333-44ef-ad06-974aa96f80ac tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:18.839938 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2a790285-8333-44ef-ad06-974aa96f80ac tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:18.969371 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-2a790285-8333-44ef-ad06-974aa96f80ac tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:18.977351 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-2a790285-8333-44ef-ad06-974aa96f80ac tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2" status: 200 len: 1503 microversion: 2.1 time: 0.151812 Aug 12 11:57:18.977902 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 460/925] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:18 2022] GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:19.998411 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-b6c7ad15-5327-4d3f-b7cb-b0a74d2693c0 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:19.998975 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-b6c7ad15-5327-4d3f-b7cb-b0a74d2693c0 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 883ed732-b52e-4ea3-a999-4cda67b267d2] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:20.005342 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b6c7ad15-5327-4d3f-b7cb-b0a74d2693c0 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:20.005820 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b6c7ad15-5327-4d3f-b7cb-b0a74d2693c0 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:20.006255 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b6c7ad15-5327-4d3f-b7cb-b0a74d2693c0 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:20.006964 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b6c7ad15-5327-4d3f-b7cb-b0a74d2693c0 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:20.007419 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b6c7ad15-5327-4d3f-b7cb-b0a74d2693c0 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:20.007841 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b6c7ad15-5327-4d3f-b7cb-b0a74d2693c0 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:20.133493 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-b6c7ad15-5327-4d3f-b7cb-b0a74d2693c0 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:20.141052 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-b6c7ad15-5327-4d3f-b7cb-b0a74d2693c0 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2" status: 200 len: 1503 microversion: 2.1 time: 0.146583 Aug 12 11:57:20.141618 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 466/926] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:19 2022] GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2 => generated 1503 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:21.161708 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-0474983c-28a1-413e-bb45-f1e6ca7fa05e tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:21.162302 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-0474983c-28a1-413e-bb45-f1e6ca7fa05e tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 883ed732-b52e-4ea3-a999-4cda67b267d2] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:21.168768 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0474983c-28a1-413e-bb45-f1e6ca7fa05e tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:21.169254 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0474983c-28a1-413e-bb45-f1e6ca7fa05e tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:21.169715 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0474983c-28a1-413e-bb45-f1e6ca7fa05e tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:21.170406 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0474983c-28a1-413e-bb45-f1e6ca7fa05e tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:21.170920 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0474983c-28a1-413e-bb45-f1e6ca7fa05e tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:21.171348 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0474983c-28a1-413e-bb45-f1e6ca7fa05e tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:21.308483 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-0474983c-28a1-413e-bb45-f1e6ca7fa05e tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:21.316672 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-0474983c-28a1-413e-bb45-f1e6ca7fa05e tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2" status: 200 len: 1503 microversion: 2.1 time: 0.158826 Aug 12 11:57:21.317238 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 461/927] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:21 2022] GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:22.338588 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e8559ecf-a38a-41a6-9c9a-409d3678b077 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:22.339496 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-e8559ecf-a38a-41a6-9c9a-409d3678b077 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 883ed732-b52e-4ea3-a999-4cda67b267d2] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:22.349762 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e8559ecf-a38a-41a6-9c9a-409d3678b077 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:22.350069 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e8559ecf-a38a-41a6-9c9a-409d3678b077 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:22.351013 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e8559ecf-a38a-41a6-9c9a-409d3678b077 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:22.352565 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e8559ecf-a38a-41a6-9c9a-409d3678b077 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:22.353093 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e8559ecf-a38a-41a6-9c9a-409d3678b077 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:22.353978 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e8559ecf-a38a-41a6-9c9a-409d3678b077 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:22.379735 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-45b09576-4948-463e-8e74-6d36c5b575c2 req-f4b46e00-7495-4c70-9441-aceaf030bbb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "883ed732-b52e-4ea3-a999-4cda67b267d2", "name": "network-vif-deleted", "tag": "d35e4fcf-a2d6-4b95-b5d7-cbe164c21ab1"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:57:22.393487 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-45b09576-4948-463e-8e74-6d36c5b575c2 req-f4b46e00-7495-4c70-9441-aceaf030bbb3 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:22.394338 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-45b09576-4948-463e-8e74-6d36c5b575c2 req-f4b46e00-7495-4c70-9441-aceaf030bbb3 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:22.394994 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-45b09576-4948-463e-8e74-6d36c5b575c2 req-f4b46e00-7495-4c70-9441-aceaf030bbb3 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:22.407697 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-45b09576-4948-463e-8e74-6d36c5b575c2 req-f4b46e00-7495-4c70-9441-aceaf030bbb3 service nova] Creating event network-vif-deleted:d35e4fcf-a2d6-4b95-b5d7-cbe164c21ab1 for instance 883ed732-b52e-4ea3-a999-4cda67b267d2 on hv-cinder-85282 Aug 12 11:57:22.413287 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-45b09576-4948-463e-8e74-6d36c5b575c2 req-f4b46e00-7495-4c70-9441-aceaf030bbb3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037166 Aug 12 11:57:22.414040 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 462/928] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:57:22.444846 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-e8559ecf-a38a-41a6-9c9a-409d3678b077 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:22.452430 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-e8559ecf-a38a-41a6-9c9a-409d3678b077 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2" status: 200 len: 1461 microversion: 2.1 time: 0.117989 Aug 12 11:57:22.452998 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 467/929] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:22 2022] GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2 => generated 1461 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:23.474921 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-c9d9558d-d873-4584-8a2e-478ae607cf45 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:23.475728 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-c9d9558d-d873-4584-8a2e-478ae607cf45 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 883ed732-b52e-4ea3-a999-4cda67b267d2] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:23.482002 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c9d9558d-d873-4584-8a2e-478ae607cf45 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:23.482497 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c9d9558d-d873-4584-8a2e-478ae607cf45 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:23.483003 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c9d9558d-d873-4584-8a2e-478ae607cf45 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:23.483659 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c9d9558d-d873-4584-8a2e-478ae607cf45 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:23.484111 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c9d9558d-d873-4584-8a2e-478ae607cf45 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:23.484532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c9d9558d-d873-4584-8a2e-478ae607cf45 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:23.498108 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.wsgi [None req-c9d9558d-d873-4584-8a2e-478ae607cf45 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] HTTP exception thrown: Instance 883ed732-b52e-4ea3-a999-4cda67b267d2 could not be found. Aug 12 11:57:23.499769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-c9d9558d-d873-4584-8a2e-478ae607cf45 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Request method failure captured: Aug 12 11:57:23.499769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2 HTTP/1.1 Aug 12 11:57:23.499769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 11:57:23.499769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 11:57:23.499769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 11:57:23.499769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 0 Aug 12 11:57:23.499769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 11:57:23.499769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 11:57:23.499769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 11:57:23.499769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 11:57:23.499769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9kAL3bUsb5reFYNRJLu1qg0FFXBce13qvnC4WN2_ohoLejPykN8yx2-ibjL1lrPgT_LU-yYT--d6mWzKUUwrSStoSRHTwB-_P2v9LsE1JU-Tx8rifV3kgDXnh2ZDuHkB0BnDm_rv3upaxSxw8QzUyQZdonluYIUEs1_YwoD8A5mQS9U Aug 12 11:57:23.499769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 11:57:23.499769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 11:57:23.499769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 11:57:23.499769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 11:57:23.499769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 11:57:23.499769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 11:57:23.499769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: e5c85fe65feb4b3f890372c8da841629 Aug 12 11:57:23.499769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-VolumesActionsTest-1820733518 Aug 12 11:57:23.499769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 11:57:23.499769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 11:57:23.501432 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e5c85fe65feb4b3f890372c8da841629", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e5c85fe65feb4b3f890372c8da841629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5c85fe65feb4b3f890372c8da841629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5c85fe65feb4b3f890372c8da841629"}]}] Aug 12 11:57:23.501432 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-VolumesActionsTest-1820733518 Aug 12 11:57:23.501432 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: e5c85fe65feb4b3f890372c8da841629 Aug 12 11:57:23.501432 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-VolumesActionsTest-1820733518 Aug 12 11:57:23.501432 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-VolumesActionsTest-1820733518-project Aug 12 11:57:23.501432 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 11:57:23.501432 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 11:57:23.501432 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: bdbf4f974f1747188e46c85a3601124a Aug 12 11:57:23.501432 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-VolumesActionsTest-1820733518-project Aug 12 11:57:23.501432 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: > Aug 12 11:57:23.501432 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Instance 883ed732-b52e-4ea3-a999-4cda67b267d2 could not be found. Aug 12 11:57:23.501432 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'id': '883ed732-b52e-4ea3-a999-4cda67b267d2'} Aug 12 11:57:23.502322 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:57:23.502322 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:57:23.502322 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:57:23.502322 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:57:23.502322 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:57:23.502322 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:57:23.502322 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:57:23.502322 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:57:23.502322 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:57:23.502322 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:57:23.502322 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 883ed732-b52e-4ea3-a999-4cda67b267d2 could not be found. Aug 12 11:57:23.502322 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:57:23.502322 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:57:23.502322 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:57:23.502322 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:57:23.502322 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:57:23.502322 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:57:23.502322 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:57:23.502322 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:57:23.502322 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:57:23.504430 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:57:23.504430 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:57:23.504430 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:57:23.504430 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:57:23.504430 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:57:23.504430 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:57:23.504430 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:57:23.504430 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 883ed732-b52e-4ea3-a999-4cda67b267d2 could not be found. Aug 12 11:57:23.504430 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:57:23.504430 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:57:23.504430 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:57:23.504430 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:57:23.504430 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:57:23.504430 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:57:23.504430 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:57:23.504430 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:57:23.504430 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 883ed732-b52e-4ea3-a999-4cda67b267d2 could not be found. Aug 12 11:57:23.504430 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:57:23.505755 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-c9d9558d-d873-4584-8a2e-478ae607cf45 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Returning 404 to user: Instance 883ed732-b52e-4ea3-a999-4cda67b267d2 could not be found. {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:57:23.505755 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-c9d9558d-d873-4584-8a2e-478ae607cf45 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2" status: 404 len: 111 microversion: 2.1 time: 0.031645 Aug 12 11:57:23.505755 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 463/930] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:23 2022] GET /compute/v2.1/servers/883ed732-b52e-4ea3-a999-4cda67b267d2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:57:23.613991 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-27e514af-651b-4f3e-8149-6b12f23b89c7 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-122607250", "imageRef": "2887ca5b-6aa2-4cc4-a2be-9322a733fc6d", "flavorRef": "452", "networks": [{"uuid": "c572b318-b1f8-4da9-bbc9-3d1444c7f138"}]}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:57:23.669032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.network.neutron [None req-27e514af-651b-4f3e-8149-6b12f23b89c7 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] validate_networks() for [('c572b318-b1f8-4da9-bbc9-3d1444c7f138', None, None, None, None, None)] {{(pid=132281) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 11:57:24.030831 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-27e514af-651b-4f3e-8149-6b12f23b89c7 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Flavor limits 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 11:57:24.031256 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-27e514af-651b-4f3e-8149-6b12f23b89c7 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Image limits 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 11:57:24.031734 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-27e514af-651b-4f3e-8149-6b12f23b89c7 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Flavor pref 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 11:57:24.032144 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-27e514af-651b-4f3e-8149-6b12f23b89c7 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Image pref 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 11:57:24.032568 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-27e514af-651b-4f3e-8149-6b12f23b89c7 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 11:57:24.041985 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-27e514af-651b-4f3e-8149-6b12f23b89c7 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:24.042467 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-27e514af-651b-4f3e-8149-6b12f23b89c7 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:24.042929 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-27e514af-651b-4f3e-8149-6b12f23b89c7 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:24.043677 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-27e514af-651b-4f3e-8149-6b12f23b89c7 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:24.044122 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-27e514af-651b-4f3e-8149-6b12f23b89c7 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:24.044537 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-27e514af-651b-4f3e-8149-6b12f23b89c7 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:24.061924 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.quota [None req-27e514af-651b-4f3e-8149-6b12f23b89c7 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Getting quotas for project e5c85fe65feb4b3f890372c8da841629. Resources: {'instances', 'ram', 'cores'} {{(pid=132281) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:57:24.066123 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.quota [None req-27e514af-651b-4f3e-8149-6b12f23b89c7 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Getting quotas for user bdbf4f974f1747188e46c85a3601124a and project e5c85fe65feb4b3f890372c8da841629. Resources: {'instances', 'ram', 'cores'} {{(pid=132281) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:57:24.077264 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-27e514af-651b-4f3e-8149-6b12f23b89c7 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Going to run 1 instances... {{(pid=132281) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 11:57:24.079558 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-27e514af-651b-4f3e-8149-6b12f23b89c7 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 5e95ad75-c242-49b4-ab5f-8777ef590958] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2887ca5b-6aa2-4cc4-a2be-9322a733fc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132281) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 11:57:24.134157 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-27e514af-651b-4f3e-8149-6b12f23b89c7 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524401 Aug 12 11:57:24.134833 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 468/931] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Aug 12 11:57:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 11:57:24.145999 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e071ae76-7493-405b-a4ae-11e8aa4ded27 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:24.146600 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-e071ae76-7493-405b-a4ae-11e8aa4ded27 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 5e95ad75-c242-49b4-ab5f-8777ef590958] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:24.220149 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e071ae76-7493-405b-a4ae-11e8aa4ded27 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:24.232053 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e071ae76-7493-405b-a4ae-11e8aa4ded27 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958" status: 200 len: 1213 microversion: 2.1 time: 0.090273 Aug 12 11:57:24.234643 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 464/932] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:24 2022] GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:25.258559 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-f28a1bfa-301c-4e3d-bda1-6986eabaa65b tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:25.259208 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-f28a1bfa-301c-4e3d-bda1-6986eabaa65b tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 5e95ad75-c242-49b4-ab5f-8777ef590958] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:25.284329 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f28a1bfa-301c-4e3d-bda1-6986eabaa65b tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:25.284823 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f28a1bfa-301c-4e3d-bda1-6986eabaa65b tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:25.285257 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f28a1bfa-301c-4e3d-bda1-6986eabaa65b tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:25.285963 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f28a1bfa-301c-4e3d-bda1-6986eabaa65b tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:25.286408 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f28a1bfa-301c-4e3d-bda1-6986eabaa65b tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:25.286856 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f28a1bfa-301c-4e3d-bda1-6986eabaa65b tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:25.388757 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-f28a1bfa-301c-4e3d-bda1-6986eabaa65b tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:25.397084 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-f28a1bfa-301c-4e3d-bda1-6986eabaa65b tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958" status: 200 len: 1283 microversion: 2.1 time: 0.148357 Aug 12 11:57:25.397667 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 469/933] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:25 2022] GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958 => generated 1283 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:25.883279 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-f7a701f6-970d-4890-875b-ccd1fb661494 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:25.884472 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-f7a701f6-970d-4890-875b-ccd1fb661494 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: de11929c-e125-4e21-b5b1-1cd777200e4c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:25.897512 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f7a701f6-970d-4890-875b-ccd1fb661494 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:25.898088 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f7a701f6-970d-4890-875b-ccd1fb661494 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:25.899606 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f7a701f6-970d-4890-875b-ccd1fb661494 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:25.900400 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f7a701f6-970d-4890-875b-ccd1fb661494 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:25.902011 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f7a701f6-970d-4890-875b-ccd1fb661494 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:25.903818 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f7a701f6-970d-4890-875b-ccd1fb661494 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:26.034041 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.objects.instance [None req-f7a701f6-970d-4890-875b-ccd1fb661494 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lazy-loading 'services' on Instance uuid de11929c-e125-4e21-b5b1-1cd777200e4c {{(pid=132282) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:57:26.118738 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-f7a701f6-970d-4890-875b-ccd1fb661494 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "DELETE /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c/os-volume_attachments/d5062ced-3485-4275-8816-b9ba342c7490" status: 202 len: 0 microversion: 2.1 time: 0.241061 Aug 12 11:57:26.119409 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 465/934] 10.222.0.42 () {58 vars in 1416 bytes} [Fri Aug 12 11:57:25 2022] DELETE /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c/os-volume_attachments/d5062ced-3485-4275-8816-b9ba342c7490 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:57:26.417973 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-9f9f402a-3726-4fc2-a3cf-e6ef7de903b3 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:26.418357 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-9f9f402a-3726-4fc2-a3cf-e6ef7de903b3 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 5e95ad75-c242-49b4-ab5f-8777ef590958] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:26.425373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9f9f402a-3726-4fc2-a3cf-e6ef7de903b3 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:26.425865 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9f9f402a-3726-4fc2-a3cf-e6ef7de903b3 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:26.426432 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9f9f402a-3726-4fc2-a3cf-e6ef7de903b3 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:26.427242 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9f9f402a-3726-4fc2-a3cf-e6ef7de903b3 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:26.427698 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9f9f402a-3726-4fc2-a3cf-e6ef7de903b3 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:26.428153 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9f9f402a-3726-4fc2-a3cf-e6ef7de903b3 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:26.650532 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-9f9f402a-3726-4fc2-a3cf-e6ef7de903b3 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:26.659073 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-9f9f402a-3726-4fc2-a3cf-e6ef7de903b3 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958" status: 200 len: 1313 microversion: 2.1 time: 0.245493 Aug 12 11:57:26.659737 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 470/935] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:26 2022] GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958 => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:26.748069 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-23128d53-3c40-4bf6-8fde-eb625e27be3e req-bf988d53-c42c-4cfa-82a5-ccf5849ceadd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e95ad75-c242-49b4-ab5f-8777ef590958", "tag": "c6c60eee-8470-4cef-81ed-7160945f2218"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:57:26.758439 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-23128d53-3c40-4bf6-8fde-eb625e27be3e req-bf988d53-c42c-4cfa-82a5-ccf5849ceadd service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:26.758936 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-23128d53-3c40-4bf6-8fde-eb625e27be3e req-bf988d53-c42c-4cfa-82a5-ccf5849ceadd service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:26.759508 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-23128d53-3c40-4bf6-8fde-eb625e27be3e req-bf988d53-c42c-4cfa-82a5-ccf5849ceadd service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:26.770111 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-23128d53-3c40-4bf6-8fde-eb625e27be3e req-bf988d53-c42c-4cfa-82a5-ccf5849ceadd service nova] Creating event network-changed:c6c60eee-8470-4cef-81ed-7160945f2218 for instance 5e95ad75-c242-49b4-ab5f-8777ef590958 on hv-cinder-85282 Aug 12 11:57:26.774683 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-23128d53-3c40-4bf6-8fde-eb625e27be3e req-bf988d53-c42c-4cfa-82a5-ccf5849ceadd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030699 Aug 12 11:57:26.775257 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 466/936] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:57:27.274585 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-c04863df-06ea-4460-a99c-28014870bd65 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:27.275456 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-c04863df-06ea-4460-a99c-28014870bd65 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: de11929c-e125-4e21-b5b1-1cd777200e4c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:27.282935 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c04863df-06ea-4460-a99c-28014870bd65 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:27.283623 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c04863df-06ea-4460-a99c-28014870bd65 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:27.284782 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c04863df-06ea-4460-a99c-28014870bd65 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:27.285617 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c04863df-06ea-4460-a99c-28014870bd65 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:27.286168 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c04863df-06ea-4460-a99c-28014870bd65 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:27.286733 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c04863df-06ea-4460-a99c-28014870bd65 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:27.314136 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-c04863df-06ea-4460-a99c-28014870bd65 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: de11929c-e125-4e21-b5b1-1cd777200e4c] Going to try to terminate instance {{(pid=132281) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 11:57:27.417437 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-c04863df-06ea-4460-a99c-28014870bd65 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "DELETE /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c" status: 204 len: 0 microversion: 2.1 time: 0.146425 Aug 12 11:57:27.418043 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 471/937] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Aug 12 11:57:27 2022] DELETE /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 11:57:27.428050 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-ee19323e-6229-4476-9da5-623b2981a9f4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:27.429283 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-ee19323e-6229-4476-9da5-623b2981a9f4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: de11929c-e125-4e21-b5b1-1cd777200e4c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:27.435608 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ee19323e-6229-4476-9da5-623b2981a9f4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:27.436100 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ee19323e-6229-4476-9da5-623b2981a9f4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:27.436538 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ee19323e-6229-4476-9da5-623b2981a9f4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:27.437283 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ee19323e-6229-4476-9da5-623b2981a9f4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:27.437742 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ee19323e-6229-4476-9da5-623b2981a9f4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:27.438428 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ee19323e-6229-4476-9da5-623b2981a9f4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:27.594771 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-ee19323e-6229-4476-9da5-623b2981a9f4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:27.602624 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-ee19323e-6229-4476-9da5-623b2981a9f4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c" status: 200 len: 1513 microversion: 2.1 time: 0.179690 Aug 12 11:57:27.603184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 467/938] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:27 2022] GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:27.681521 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-a34fd418-4d36-4530-bf6c-799be4bba147 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:27.682335 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-a34fd418-4d36-4530-bf6c-799be4bba147 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 5e95ad75-c242-49b4-ab5f-8777ef590958] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:27.689428 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a34fd418-4d36-4530-bf6c-799be4bba147 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:27.690131 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a34fd418-4d36-4530-bf6c-799be4bba147 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:27.690640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a34fd418-4d36-4530-bf6c-799be4bba147 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:27.691348 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a34fd418-4d36-4530-bf6c-799be4bba147 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:27.691802 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a34fd418-4d36-4530-bf6c-799be4bba147 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:27.692224 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a34fd418-4d36-4530-bf6c-799be4bba147 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:27.829296 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-a34fd418-4d36-4530-bf6c-799be4bba147 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:27.837478 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-a34fd418-4d36-4530-bf6c-799be4bba147 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958" status: 200 len: 1313 microversion: 2.1 time: 0.160385 Aug 12 11:57:27.838045 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 472/939] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:27 2022] GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:28.625990 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-44f793d8-3688-4700-8067-91bad8015984 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:28.626674 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-44f793d8-3688-4700-8067-91bad8015984 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: de11929c-e125-4e21-b5b1-1cd777200e4c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:28.633406 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-44f793d8-3688-4700-8067-91bad8015984 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:28.633970 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-44f793d8-3688-4700-8067-91bad8015984 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:28.634518 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-44f793d8-3688-4700-8067-91bad8015984 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:28.635306 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-44f793d8-3688-4700-8067-91bad8015984 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:28.635895 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-44f793d8-3688-4700-8067-91bad8015984 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:28.636308 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-44f793d8-3688-4700-8067-91bad8015984 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:28.762122 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-44f793d8-3688-4700-8067-91bad8015984 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:28.770162 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-44f793d8-3688-4700-8067-91bad8015984 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c" status: 200 len: 1513 microversion: 2.1 time: 0.148357 Aug 12 11:57:28.770735 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 468/940] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:28 2022] GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:28.858401 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-7e5547c5-13c1-4150-9f18-418648d1820d tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:28.859043 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-7e5547c5-13c1-4150-9f18-418648d1820d tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 5e95ad75-c242-49b4-ab5f-8777ef590958] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:28.865415 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7e5547c5-13c1-4150-9f18-418648d1820d tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:28.865898 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7e5547c5-13c1-4150-9f18-418648d1820d tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:28.866333 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7e5547c5-13c1-4150-9f18-418648d1820d tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:28.867050 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7e5547c5-13c1-4150-9f18-418648d1820d tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:28.867499 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7e5547c5-13c1-4150-9f18-418648d1820d tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:28.867919 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7e5547c5-13c1-4150-9f18-418648d1820d tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:28.995431 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-7e5547c5-13c1-4150-9f18-418648d1820d tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:29.003290 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-7e5547c5-13c1-4150-9f18-418648d1820d tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958" status: 200 len: 1313 microversion: 2.1 time: 0.148208 Aug 12 11:57:29.003852 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 473/941] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:28 2022] GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:29.791124 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-94d77db8-bcf9-4ecc-9b0d-9a3c208dc31f tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:29.791791 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-94d77db8-bcf9-4ecc-9b0d-9a3c208dc31f tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: de11929c-e125-4e21-b5b1-1cd777200e4c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:29.798222 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-94d77db8-bcf9-4ecc-9b0d-9a3c208dc31f tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:29.798739 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-94d77db8-bcf9-4ecc-9b0d-9a3c208dc31f tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:29.799178 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-94d77db8-bcf9-4ecc-9b0d-9a3c208dc31f tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:29.800479 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-94d77db8-bcf9-4ecc-9b0d-9a3c208dc31f tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:29.800935 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-94d77db8-bcf9-4ecc-9b0d-9a3c208dc31f tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:29.801359 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-94d77db8-bcf9-4ecc-9b0d-9a3c208dc31f tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:29.929102 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-94d77db8-bcf9-4ecc-9b0d-9a3c208dc31f tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:29.936414 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-94d77db8-bcf9-4ecc-9b0d-9a3c208dc31f tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c" status: 200 len: 1513 microversion: 2.1 time: 0.149193 Aug 12 11:57:29.936966 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 469/942] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:29 2022] GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:30.023279 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-32262e30-9a5b-4ad0-bb90-9bdb3467743b tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:30.023888 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-32262e30-9a5b-4ad0-bb90-9bdb3467743b tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 5e95ad75-c242-49b4-ab5f-8777ef590958] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:30.030429 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-32262e30-9a5b-4ad0-bb90-9bdb3467743b tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:30.030944 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-32262e30-9a5b-4ad0-bb90-9bdb3467743b tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:30.031407 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-32262e30-9a5b-4ad0-bb90-9bdb3467743b tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:30.032093 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-32262e30-9a5b-4ad0-bb90-9bdb3467743b tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:30.032540 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-32262e30-9a5b-4ad0-bb90-9bdb3467743b tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:30.032980 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-32262e30-9a5b-4ad0-bb90-9bdb3467743b tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:30.161104 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-32262e30-9a5b-4ad0-bb90-9bdb3467743b tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:30.168442 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-32262e30-9a5b-4ad0-bb90-9bdb3467743b tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958" status: 200 len: 1313 microversion: 2.1 time: 0.149070 Aug 12 11:57:30.169001 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 474/943] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:30 2022] GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:30.957564 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-a853a142-e48a-42b7-aa6a-acb5f96e07d2 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:30.958175 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-a853a142-e48a-42b7-aa6a-acb5f96e07d2 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: de11929c-e125-4e21-b5b1-1cd777200e4c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:30.964596 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a853a142-e48a-42b7-aa6a-acb5f96e07d2 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:30.965125 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a853a142-e48a-42b7-aa6a-acb5f96e07d2 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:30.965566 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a853a142-e48a-42b7-aa6a-acb5f96e07d2 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:30.966285 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a853a142-e48a-42b7-aa6a-acb5f96e07d2 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:30.966776 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a853a142-e48a-42b7-aa6a-acb5f96e07d2 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:30.967199 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a853a142-e48a-42b7-aa6a-acb5f96e07d2 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:31.186814 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-a853a142-e48a-42b7-aa6a-acb5f96e07d2 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:31.189297 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-b7aa10e3-b75c-4f19-8fe5-b3a65d7f6b92 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:31.189906 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-b7aa10e3-b75c-4f19-8fe5-b3a65d7f6b92 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 5e95ad75-c242-49b4-ab5f-8777ef590958] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:31.194946 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-a853a142-e48a-42b7-aa6a-acb5f96e07d2 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c" status: 200 len: 1513 microversion: 2.1 time: 0.241573 Aug 12 11:57:31.206651 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 470/944] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:30 2022] GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c => generated 1513 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:31.206995 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b7aa10e3-b75c-4f19-8fe5-b3a65d7f6b92 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:31.206995 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b7aa10e3-b75c-4f19-8fe5-b3a65d7f6b92 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:31.206995 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b7aa10e3-b75c-4f19-8fe5-b3a65d7f6b92 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:31.206995 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b7aa10e3-b75c-4f19-8fe5-b3a65d7f6b92 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:31.207357 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b7aa10e3-b75c-4f19-8fe5-b3a65d7f6b92 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:31.207357 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b7aa10e3-b75c-4f19-8fe5-b3a65d7f6b92 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:31.368188 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-b7aa10e3-b75c-4f19-8fe5-b3a65d7f6b92 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:31.375717 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-b7aa10e3-b75c-4f19-8fe5-b3a65d7f6b92 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958" status: 200 len: 1313 microversion: 2.1 time: 0.190422 Aug 12 11:57:31.376267 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 475/945] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:31 2022] GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:57:32.219305 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-efe2bcc1-de70-4d28-aa81-38629d7d5af0 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:32.219926 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-efe2bcc1-de70-4d28-aa81-38629d7d5af0 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: de11929c-e125-4e21-b5b1-1cd777200e4c] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:32.227072 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-efe2bcc1-de70-4d28-aa81-38629d7d5af0 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:32.227558 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-efe2bcc1-de70-4d28-aa81-38629d7d5af0 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:32.228053 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-efe2bcc1-de70-4d28-aa81-38629d7d5af0 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:32.228783 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-efe2bcc1-de70-4d28-aa81-38629d7d5af0 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:32.229207 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-efe2bcc1-de70-4d28-aa81-38629d7d5af0 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:32.229631 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-efe2bcc1-de70-4d28-aa81-38629d7d5af0 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:32.369649 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-efe2bcc1-de70-4d28-aa81-38629d7d5af0 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:32.377454 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-efe2bcc1-de70-4d28-aa81-38629d7d5af0 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c" status: 200 len: 1513 microversion: 2.1 time: 0.162235 Aug 12 11:57:32.378588 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 471/946] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:32 2022] GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:32.396511 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-bece65f8-71fc-4a02-9e16-2d5eb0ddd693 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:32.397127 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-bece65f8-71fc-4a02-9e16-2d5eb0ddd693 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 5e95ad75-c242-49b4-ab5f-8777ef590958] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:32.403570 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bece65f8-71fc-4a02-9e16-2d5eb0ddd693 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:32.404058 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bece65f8-71fc-4a02-9e16-2d5eb0ddd693 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:32.404489 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bece65f8-71fc-4a02-9e16-2d5eb0ddd693 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:32.405185 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bece65f8-71fc-4a02-9e16-2d5eb0ddd693 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:32.405811 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bece65f8-71fc-4a02-9e16-2d5eb0ddd693 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:32.406399 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bece65f8-71fc-4a02-9e16-2d5eb0ddd693 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:32.629927 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-bece65f8-71fc-4a02-9e16-2d5eb0ddd693 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:32.638325 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-bece65f8-71fc-4a02-9e16-2d5eb0ddd693 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958" status: 200 len: 1313 microversion: 2.1 time: 0.246012 Aug 12 11:57:32.639234 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 476/947] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:32 2022] GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:33.373584 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-ec55d5bf-1b35-4890-9c4d-3e1d54409e6d req-71314673-558a-49e4-ad25-689db2905524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de11929c-e125-4e21-b5b1-1cd777200e4c", "name": "network-vif-deleted", "tag": "8f57f664-cc1c-4b51-b503-85f993f78c79"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:57:33.384645 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-ec55d5bf-1b35-4890-9c4d-3e1d54409e6d req-71314673-558a-49e4-ad25-689db2905524 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:33.385255 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-ec55d5bf-1b35-4890-9c4d-3e1d54409e6d req-71314673-558a-49e4-ad25-689db2905524 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:33.385948 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-ec55d5bf-1b35-4890-9c4d-3e1d54409e6d req-71314673-558a-49e4-ad25-689db2905524 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:33.389387 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:33.402140 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-ec55d5bf-1b35-4890-9c4d-3e1d54409e6d req-71314673-558a-49e4-ad25-689db2905524 service nova] Creating event network-vif-deleted:8f57f664-cc1c-4b51-b503-85f993f78c79 for instance de11929c-e125-4e21-b5b1-1cd777200e4c on hv-cinder-85282 Aug 12 11:57:33.403789 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-db7320bf-a8d0-4af6-b698-0713701165d8 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:33.404527 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-db7320bf-a8d0-4af6-b698-0713701165d8 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: de11929c-e125-4e21-b5b1-1cd777200e4c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:33.411741 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-ec55d5bf-1b35-4890-9c4d-3e1d54409e6d req-71314673-558a-49e4-ad25-689db2905524 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041690 Aug 12 11:57:33.413136 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 472/948] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:57:33.422183 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-db7320bf-a8d0-4af6-b698-0713701165d8 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:33.422933 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-db7320bf-a8d0-4af6-b698-0713701165d8 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:33.423418 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-db7320bf-a8d0-4af6-b698-0713701165d8 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:33.424324 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-db7320bf-a8d0-4af6-b698-0713701165d8 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:33.425341 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-db7320bf-a8d0-4af6-b698-0713701165d8 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:33.425890 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-db7320bf-a8d0-4af6-b698-0713701165d8 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:33.499323 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-db7320bf-a8d0-4af6-b698-0713701165d8 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:33.508707 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-db7320bf-a8d0-4af6-b698-0713701165d8 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c" status: 200 len: 1304 microversion: 2.1 time: 0.111291 Aug 12 11:57:33.509320 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 477/949] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:33 2022] GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:57:33.660993 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-8d6fdb9d-c0c5-47ce-9af0-9ca7a8817c74 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:33.661909 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-8d6fdb9d-c0c5-47ce-9af0-9ca7a8817c74 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 5e95ad75-c242-49b4-ab5f-8777ef590958] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:33.669239 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8d6fdb9d-c0c5-47ce-9af0-9ca7a8817c74 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:33.670205 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8d6fdb9d-c0c5-47ce-9af0-9ca7a8817c74 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:33.670849 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8d6fdb9d-c0c5-47ce-9af0-9ca7a8817c74 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:33.672010 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8d6fdb9d-c0c5-47ce-9af0-9ca7a8817c74 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:33.672629 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8d6fdb9d-c0c5-47ce-9af0-9ca7a8817c74 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:33.673229 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8d6fdb9d-c0c5-47ce-9af0-9ca7a8817c74 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:33.844680 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-8d6fdb9d-c0c5-47ce-9af0-9ca7a8817c74 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:33.852685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-8d6fdb9d-c0c5-47ce-9af0-9ca7a8817c74 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958" status: 200 len: 1313 microversion: 2.1 time: 0.197321 Aug 12 11:57:33.853243 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 473/950] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:33 2022] GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:34.531688 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-a0a1715b-e9eb-4ce5-94b6-dba5a4cd12c4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:34.533222 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-a0a1715b-e9eb-4ce5-94b6-dba5a4cd12c4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: de11929c-e125-4e21-b5b1-1cd777200e4c] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:34.539102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell0:SELECT=2 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:34.539728 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell0:SELECT=6 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:34.543052 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a0a1715b-e9eb-4ce5-94b6-dba5a4cd12c4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:34.544020 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a0a1715b-e9eb-4ce5-94b6-dba5a4cd12c4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:34.544581 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a0a1715b-e9eb-4ce5-94b6-dba5a4cd12c4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:34.545473 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a0a1715b-e9eb-4ce5-94b6-dba5a4cd12c4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:34.545937 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a0a1715b-e9eb-4ce5-94b6-dba5a4cd12c4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:34.546383 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a0a1715b-e9eb-4ce5-94b6-dba5a4cd12c4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:34.563702 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.wsgi [None req-a0a1715b-e9eb-4ce5-94b6-dba5a4cd12c4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] HTTP exception thrown: Instance de11929c-e125-4e21-b5b1-1cd777200e4c could not be found. Aug 12 11:57:34.566102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-a0a1715b-e9eb-4ce5-94b6-dba5a4cd12c4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Request method failure captured: Aug 12 11:57:34.566102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c HTTP/1.1 Aug 12 11:57:34.566102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 11:57:34.566102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 11:57:34.566102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 11:57:34.566102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 0 Aug 12 11:57:34.566102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 11:57:34.566102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 11:57:34.566102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 11:57:34.566102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 11:57:34.566102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9j_wjMgo4WpUMqMDFOF-4x_zOU-JRbfj4dc9Yw9rki2TNjWo2Prw_ifYqfu_11zlK-OWJ3HqAuW5LII8k4s4rL6BhPt-p1ySeOoqol2t3W_sfh6Aopcy45BNkWgr0-8ckSMI4UgaBPQMcRu4AxnU3PhTSgZsxlzmxUE6cBXyhdZetmA Aug 12 11:57:34.566102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 11:57:34.566102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 11:57:34.566102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 11:57:34.566102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 11:57:34.566102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 11:57:34.566102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 11:57:34.566102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: 8c66a0584e9345c392d95524bdcc7f16 Aug 12 11:57:34.566102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-VolumesSnapshotTestJSON-311631556 Aug 12 11:57:34.566102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 11:57:34.566102 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 11:57:34.567852 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8c66a0584e9345c392d95524bdcc7f16", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8c66a0584e9345c392d95524bdcc7f16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8c66a0584e9345c392d95524bdcc7f16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8c66a0584e9345c392d95524bdcc7f16"}]}] Aug 12 11:57:34.567852 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-VolumesSnapshotTestJSON-311631556 Aug 12 11:57:34.567852 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: 8c66a0584e9345c392d95524bdcc7f16 Aug 12 11:57:34.567852 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-311631556 Aug 12 11:57:34.567852 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-VolumesSnapshotTestJSON-311631556-project Aug 12 11:57:34.567852 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 11:57:34.567852 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 11:57:34.567852 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: 10ddb84a8b734c70b7b55685a1a12f95 Aug 12 11:57:34.567852 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-VolumesSnapshotTestJSON-311631556-project Aug 12 11:57:34.567852 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: > Aug 12 11:57:34.567852 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Instance de11929c-e125-4e21-b5b1-1cd777200e4c could not be found. Aug 12 11:57:34.567852 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'id': 'de11929c-e125-4e21-b5b1-1cd777200e4c'} Aug 12 11:57:34.568776 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:57:34.568776 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:57:34.568776 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:57:34.568776 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:57:34.568776 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:57:34.568776 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:57:34.568776 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:57:34.568776 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:57:34.568776 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:57:34.568776 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:57:34.568776 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de11929c-e125-4e21-b5b1-1cd777200e4c could not be found. Aug 12 11:57:34.568776 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:57:34.568776 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:57:34.568776 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:57:34.568776 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:57:34.568776 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:57:34.568776 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:57:34.568776 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:57:34.568776 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:57:34.568776 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:57:34.570128 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:57:34.570128 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:57:34.570128 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:57:34.570128 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:57:34.570128 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:57:34.570128 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:57:34.570128 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:57:34.570128 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de11929c-e125-4e21-b5b1-1cd777200e4c could not be found. Aug 12 11:57:34.570128 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:57:34.570128 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:57:34.570128 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:57:34.570128 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:57:34.570128 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:57:34.570128 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:57:34.570128 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:57:34.570128 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:57:34.570128 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de11929c-e125-4e21-b5b1-1cd777200e4c could not be found. Aug 12 11:57:34.570128 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 11:57:34.572434 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-a0a1715b-e9eb-4ce5-94b6-dba5a4cd12c4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Returning 404 to user: Instance de11929c-e125-4e21-b5b1-1cd777200e4c could not be found. {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:57:34.572434 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-a0a1715b-e9eb-4ce5-94b6-dba5a4cd12c4 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c" status: 404 len: 111 microversion: 2.1 time: 0.040519 Aug 12 11:57:34.572434 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 478/951] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:34 2022] GET /compute/v2.1/servers/de11929c-e125-4e21-b5b1-1cd777200e4c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:57:34.874977 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-9e8d9afb-61bf-4db3-93b3-dab1ac919b2e tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:34.876614 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-9e8d9afb-61bf-4db3-93b3-dab1ac919b2e tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 5e95ad75-c242-49b4-ab5f-8777ef590958] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:34.879544 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=2 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:34.880701 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:34.886761 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9e8d9afb-61bf-4db3-93b3-dab1ac919b2e tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:34.887254 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9e8d9afb-61bf-4db3-93b3-dab1ac919b2e tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:34.887693 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9e8d9afb-61bf-4db3-93b3-dab1ac919b2e tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:34.888429 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9e8d9afb-61bf-4db3-93b3-dab1ac919b2e tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:34.888886 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9e8d9afb-61bf-4db3-93b3-dab1ac919b2e tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:34.889308 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9e8d9afb-61bf-4db3-93b3-dab1ac919b2e tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:35.025440 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-9e8d9afb-61bf-4db3-93b3-dab1ac919b2e tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:35.034523 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-9e8d9afb-61bf-4db3-93b3-dab1ac919b2e tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958" status: 200 len: 1313 microversion: 2.1 time: 0.163186 Aug 12 11:57:35.035119 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 474/952] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:34 2022] GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:36.055131 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-26f3f761-baa6-427a-8eaf-cdd2cc7307af tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:36.055775 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-26f3f761-baa6-427a-8eaf-cdd2cc7307af tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 5e95ad75-c242-49b4-ab5f-8777ef590958] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:36.062120 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-26f3f761-baa6-427a-8eaf-cdd2cc7307af tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:36.062599 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-26f3f761-baa6-427a-8eaf-cdd2cc7307af tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:36.063060 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-26f3f761-baa6-427a-8eaf-cdd2cc7307af tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:36.064003 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-26f3f761-baa6-427a-8eaf-cdd2cc7307af tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:36.064455 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-26f3f761-baa6-427a-8eaf-cdd2cc7307af tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:36.064876 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-26f3f761-baa6-427a-8eaf-cdd2cc7307af tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:36.192008 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-26f3f761-baa6-427a-8eaf-cdd2cc7307af tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:36.199768 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-26f3f761-baa6-427a-8eaf-cdd2cc7307af tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958" status: 200 len: 1313 microversion: 2.1 time: 0.148345 Aug 12 11:57:36.200408 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 479/953] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:36 2022] GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:37.220532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-60eab523-5770-4c89-ab5a-99b3ef7d66c8 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:37.221061 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-60eab523-5770-4c89-ab5a-99b3ef7d66c8 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 5e95ad75-c242-49b4-ab5f-8777ef590958] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:37.228298 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-60eab523-5770-4c89-ab5a-99b3ef7d66c8 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:37.228777 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-60eab523-5770-4c89-ab5a-99b3ef7d66c8 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:37.229208 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-60eab523-5770-4c89-ab5a-99b3ef7d66c8 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:37.229888 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-60eab523-5770-4c89-ab5a-99b3ef7d66c8 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:37.230336 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-60eab523-5770-4c89-ab5a-99b3ef7d66c8 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:37.230787 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-60eab523-5770-4c89-ab5a-99b3ef7d66c8 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:37.359487 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-60eab523-5770-4c89-ab5a-99b3ef7d66c8 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:37.367502 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-60eab523-5770-4c89-ab5a-99b3ef7d66c8 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958" status: 200 len: 1313 microversion: 2.1 time: 0.150934 Aug 12 11:57:37.368051 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 475/954] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:37 2022] GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:57:37.811762 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-a7475407-e790-4ef7-bce6-1c9bfafa95a0 req-148205ce-994d-4d2a-b6fc-a5d3792bc774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e95ad75-c242-49b4-ab5f-8777ef590958", "name": "network-vif-plugged", "status": "completed", "tag": "c6c60eee-8470-4cef-81ed-7160945f2218"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:57:37.822682 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-a7475407-e790-4ef7-bce6-1c9bfafa95a0 req-148205ce-994d-4d2a-b6fc-a5d3792bc774 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:37.823162 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-a7475407-e790-4ef7-bce6-1c9bfafa95a0 req-148205ce-994d-4d2a-b6fc-a5d3792bc774 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:37.823646 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-a7475407-e790-4ef7-bce6-1c9bfafa95a0 req-148205ce-994d-4d2a-b6fc-a5d3792bc774 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:37.834493 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-a7475407-e790-4ef7-bce6-1c9bfafa95a0 req-148205ce-994d-4d2a-b6fc-a5d3792bc774 service nova] Creating event network-vif-plugged:c6c60eee-8470-4cef-81ed-7160945f2218 for instance 5e95ad75-c242-49b4-ab5f-8777ef590958 on hv-cinder-85282 Aug 12 11:57:37.839579 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-a7475407-e790-4ef7-bce6-1c9bfafa95a0 req-148205ce-994d-4d2a-b6fc-a5d3792bc774 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031426 Aug 12 11:57:37.840184 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 480/955] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:57:38.388249 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-c88b12d3-bb83-44de-90ac-6bd463c86aa4 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:38.388937 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-c88b12d3-bb83-44de-90ac-6bd463c86aa4 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 5e95ad75-c242-49b4-ab5f-8777ef590958] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:38.395596 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c88b12d3-bb83-44de-90ac-6bd463c86aa4 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:38.395946 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c88b12d3-bb83-44de-90ac-6bd463c86aa4 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:38.396436 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c88b12d3-bb83-44de-90ac-6bd463c86aa4 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:38.397124 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c88b12d3-bb83-44de-90ac-6bd463c86aa4 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:38.397571 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c88b12d3-bb83-44de-90ac-6bd463c86aa4 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:38.397986 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c88b12d3-bb83-44de-90ac-6bd463c86aa4 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:38.537800 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-c88b12d3-bb83-44de-90ac-6bd463c86aa4 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:38.545219 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-c88b12d3-bb83-44de-90ac-6bd463c86aa4 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958" status: 200 len: 1313 microversion: 2.1 time: 0.160940 Aug 12 11:57:38.545772 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 476/956] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:38 2022] GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:39.566463 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-02144d13-37d1-4d88-9163-e5e2161e7197 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:39.567182 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-02144d13-37d1-4d88-9163-e5e2161e7197 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 5e95ad75-c242-49b4-ab5f-8777ef590958] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:39.573288 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-02144d13-37d1-4d88-9163-e5e2161e7197 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:39.573772 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-02144d13-37d1-4d88-9163-e5e2161e7197 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:39.574203 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-02144d13-37d1-4d88-9163-e5e2161e7197 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:39.574949 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-02144d13-37d1-4d88-9163-e5e2161e7197 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:39.575400 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-02144d13-37d1-4d88-9163-e5e2161e7197 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:39.579430 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-02144d13-37d1-4d88-9163-e5e2161e7197 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:39.730455 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-02144d13-37d1-4d88-9163-e5e2161e7197 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:39.738724 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-02144d13-37d1-4d88-9163-e5e2161e7197 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958" status: 200 len: 1313 microversion: 2.1 time: 0.177054 Aug 12 11:57:39.742845 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 481/957] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:39 2022] GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:40.759562 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-ab0b19cc-3f9e-4375-bb7a-1920ae651ebd tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:40.760192 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-ab0b19cc-3f9e-4375-bb7a-1920ae651ebd tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 5e95ad75-c242-49b4-ab5f-8777ef590958] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:40.766967 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ab0b19cc-3f9e-4375-bb7a-1920ae651ebd tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:40.767449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ab0b19cc-3f9e-4375-bb7a-1920ae651ebd tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:40.767884 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ab0b19cc-3f9e-4375-bb7a-1920ae651ebd tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:40.768570 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ab0b19cc-3f9e-4375-bb7a-1920ae651ebd tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:40.769020 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ab0b19cc-3f9e-4375-bb7a-1920ae651ebd tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:40.769444 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ab0b19cc-3f9e-4375-bb7a-1920ae651ebd tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:40.908707 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-ab0b19cc-3f9e-4375-bb7a-1920ae651ebd tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:40.917040 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-ab0b19cc-3f9e-4375-bb7a-1920ae651ebd tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958" status: 200 len: 1497 microversion: 2.1 time: 0.161211 Aug 12 11:57:40.918185 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 477/958] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:40 2022] GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958 => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:43.715430 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-af1a5d9b-7002-4fba-9334-0f8fb1892a92 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2019999747", "imageRef": "2887ca5b-6aa2-4cc4-a2be-9322a733fc6d", "flavorRef": "452", "networks": [{"uuid": "ba0b2159-a508-4567-ae56-4128aa55964d"}]}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:57:43.785527 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.network.neutron [None req-af1a5d9b-7002-4fba-9334-0f8fb1892a92 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] validate_networks() for [('ba0b2159-a508-4567-ae56-4128aa55964d', None, None, None, None, None)] {{(pid=132281) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 11:57:43.927253 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-055f8771-211c-457b-b3bb-160a9b94fe80 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:43.928411 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-055f8771-211c-457b-b3bb-160a9b94fe80 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 5e95ad75-c242-49b4-ab5f-8777ef590958] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:43.936930 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-055f8771-211c-457b-b3bb-160a9b94fe80 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:43.937895 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-055f8771-211c-457b-b3bb-160a9b94fe80 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:43.938822 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-055f8771-211c-457b-b3bb-160a9b94fe80 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:43.939787 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-055f8771-211c-457b-b3bb-160a9b94fe80 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:43.940458 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-055f8771-211c-457b-b3bb-160a9b94fe80 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:43.941090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-055f8771-211c-457b-b3bb-160a9b94fe80 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:43.979679 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-055f8771-211c-457b-b3bb-160a9b94fe80 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 5e95ad75-c242-49b4-ab5f-8777ef590958] Going to try to terminate instance {{(pid=132282) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 11:57:44.119932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-055f8771-211c-457b-b3bb-160a9b94fe80 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958" status: 204 len: 0 microversion: 2.1 time: 0.196068 Aug 12 11:57:44.123050 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 478/959] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Aug 12 11:57:43 2022] DELETE /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 11:57:44.131344 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-c5e58c8e-b7a0-4da2-bd54-a5a906951aac tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:44.132408 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-c5e58c8e-b7a0-4da2-bd54-a5a906951aac tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 5e95ad75-c242-49b4-ab5f-8777ef590958] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:44.139111 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c5e58c8e-b7a0-4da2-bd54-a5a906951aac tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:44.139929 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c5e58c8e-b7a0-4da2-bd54-a5a906951aac tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:44.140526 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c5e58c8e-b7a0-4da2-bd54-a5a906951aac tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:44.143222 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c5e58c8e-b7a0-4da2-bd54-a5a906951aac tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:44.144056 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c5e58c8e-b7a0-4da2-bd54-a5a906951aac tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:44.144498 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c5e58c8e-b7a0-4da2-bd54-a5a906951aac tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:44.369337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-af1a5d9b-7002-4fba-9334-0f8fb1892a92 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Flavor limits 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 11:57:44.370289 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-af1a5d9b-7002-4fba-9334-0f8fb1892a92 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Image limits 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 11:57:44.370823 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-af1a5d9b-7002-4fba-9334-0f8fb1892a92 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Flavor pref 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 11:57:44.371239 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-af1a5d9b-7002-4fba-9334-0f8fb1892a92 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Image pref 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 11:57:44.371658 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-af1a5d9b-7002-4fba-9334-0f8fb1892a92 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 11:57:44.384944 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-af1a5d9b-7002-4fba-9334-0f8fb1892a92 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:44.386739 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-af1a5d9b-7002-4fba-9334-0f8fb1892a92 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:44.387260 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-af1a5d9b-7002-4fba-9334-0f8fb1892a92 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:44.388545 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-af1a5d9b-7002-4fba-9334-0f8fb1892a92 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:44.389082 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-af1a5d9b-7002-4fba-9334-0f8fb1892a92 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:44.390078 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-af1a5d9b-7002-4fba-9334-0f8fb1892a92 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:44.403738 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:44.405965 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-c5e58c8e-b7a0-4da2-bd54-a5a906951aac tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:44.417318 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-c5e58c8e-b7a0-4da2-bd54-a5a906951aac tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958" status: 200 len: 1503 microversion: 2.1 time: 0.291482 Aug 12 11:57:44.418075 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 479/960] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:44 2022] GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958 => generated 1503 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:57:44.430804 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.quota [None req-af1a5d9b-7002-4fba-9334-0f8fb1892a92 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Getting quotas for project 8c66a0584e9345c392d95524bdcc7f16. Resources: {'instances', 'ram', 'cores'} {{(pid=132281) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:57:44.436311 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.quota [None req-af1a5d9b-7002-4fba-9334-0f8fb1892a92 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Getting quotas for user 10ddb84a8b734c70b7b55685a1a12f95 and project 8c66a0584e9345c392d95524bdcc7f16. Resources: {'instances', 'ram', 'cores'} {{(pid=132281) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:57:44.453323 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-af1a5d9b-7002-4fba-9334-0f8fb1892a92 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Going to run 1 instances... {{(pid=132281) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 11:57:44.455809 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-af1a5d9b-7002-4fba-9334-0f8fb1892a92 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: c2402b33-5612-4061-ad76-2d3f05e9d166] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2887ca5b-6aa2-4cc4-a2be-9322a733fc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132281) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 11:57:44.512891 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-af1a5d9b-7002-4fba-9334-0f8fb1892a92 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.803464 Aug 12 11:57:44.515050 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 482/961] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Aug 12 11:57:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 11:57:44.525723 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-9115ce0a-08af-42fa-a293-df4ea7927ce5 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:44.526527 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-9115ce0a-08af-42fa-a293-df4ea7927ce5 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: c2402b33-5612-4061-ad76-2d3f05e9d166] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:44.588490 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-9115ce0a-08af-42fa-a293-df4ea7927ce5 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:44.599765 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-9115ce0a-08af-42fa-a293-df4ea7927ce5 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166" status: 200 len: 1219 microversion: 2.1 time: 0.077862 Aug 12 11:57:44.610512 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 480/962] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:44 2022] GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:45.439044 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-ae71160a-3704-4c4e-b209-3441d07e9f6a tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:45.440463 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-ae71160a-3704-4c4e-b209-3441d07e9f6a tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 5e95ad75-c242-49b4-ab5f-8777ef590958] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:45.449122 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ae71160a-3704-4c4e-b209-3441d07e9f6a tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:45.450153 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ae71160a-3704-4c4e-b209-3441d07e9f6a tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:45.450153 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ae71160a-3704-4c4e-b209-3441d07e9f6a tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:45.452276 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ae71160a-3704-4c4e-b209-3441d07e9f6a tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:45.452744 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ae71160a-3704-4c4e-b209-3441d07e9f6a tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:45.453172 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ae71160a-3704-4c4e-b209-3441d07e9f6a tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:45.620493 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-ed616ce0-05d8-424c-886f-bd0728055a33 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:45.621845 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-ed616ce0-05d8-424c-886f-bd0728055a33 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: c2402b33-5612-4061-ad76-2d3f05e9d166] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:45.638328 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ed616ce0-05d8-424c-886f-bd0728055a33 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:45.638939 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ed616ce0-05d8-424c-886f-bd0728055a33 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:45.639373 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ed616ce0-05d8-424c-886f-bd0728055a33 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:45.650499 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ed616ce0-05d8-424c-886f-bd0728055a33 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:45.651333 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ed616ce0-05d8-424c-886f-bd0728055a33 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:45.664166 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ed616ce0-05d8-424c-886f-bd0728055a33 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:45.732739 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-ae71160a-3704-4c4e-b209-3441d07e9f6a tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:45.743929 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-ae71160a-3704-4c4e-b209-3441d07e9f6a tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958" status: 200 len: 1503 microversion: 2.1 time: 0.309082 Aug 12 11:57:45.746132 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 483/963] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:45 2022] GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958 => generated 1503 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:45.782959 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-ed616ce0-05d8-424c-886f-bd0728055a33 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:45.791940 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-ed616ce0-05d8-424c-886f-bd0728055a33 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166" status: 200 len: 1215 microversion: 2.1 time: 0.175225 Aug 12 11:57:45.792932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 481/964] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:45 2022] GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166 => generated 1215 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:57:46.613847 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-af9d143a-1603-43bb-8464-b76a3839f37b req-408fce9a-2139-4d0c-b144-c973c1e3e639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e95ad75-c242-49b4-ab5f-8777ef590958", "name": "network-vif-deleted", "tag": "c6c60eee-8470-4cef-81ed-7160945f2218"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:57:46.625116 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-af9d143a-1603-43bb-8464-b76a3839f37b req-408fce9a-2139-4d0c-b144-c973c1e3e639 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:46.625955 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-af9d143a-1603-43bb-8464-b76a3839f37b req-408fce9a-2139-4d0c-b144-c973c1e3e639 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:46.626467 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-af9d143a-1603-43bb-8464-b76a3839f37b req-408fce9a-2139-4d0c-b144-c973c1e3e639 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:46.646924 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-af9d143a-1603-43bb-8464-b76a3839f37b req-408fce9a-2139-4d0c-b144-c973c1e3e639 service nova] Creating event network-vif-deleted:c6c60eee-8470-4cef-81ed-7160945f2218 for instance 5e95ad75-c242-49b4-ab5f-8777ef590958 on hv-cinder-85282 Aug 12 11:57:46.653681 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-af9d143a-1603-43bb-8464-b76a3839f37b req-408fce9a-2139-4d0c-b144-c973c1e3e639 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043182 Aug 12 11:57:46.654201 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 484/965] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:57:46.772687 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-7c59cf0d-dd94-4ab4-abe4-b77078876cd0 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:46.773390 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-7c59cf0d-dd94-4ab4-abe4-b77078876cd0 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 5e95ad75-c242-49b4-ab5f-8777ef590958] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:46.789389 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7c59cf0d-dd94-4ab4-abe4-b77078876cd0 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:46.792683 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7c59cf0d-dd94-4ab4-abe4-b77078876cd0 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:46.795138 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7c59cf0d-dd94-4ab4-abe4-b77078876cd0 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:46.796086 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7c59cf0d-dd94-4ab4-abe4-b77078876cd0 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:46.796712 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7c59cf0d-dd94-4ab4-abe4-b77078876cd0 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:46.798636 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7c59cf0d-dd94-4ab4-abe4-b77078876cd0 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:46.817864 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-7de73214-9031-4e4d-bfbb-071ce307f533 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:46.821265 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-7de73214-9031-4e4d-bfbb-071ce307f533 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: c2402b33-5612-4061-ad76-2d3f05e9d166] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:46.839041 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7de73214-9031-4e4d-bfbb-071ce307f533 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:46.843779 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7de73214-9031-4e4d-bfbb-071ce307f533 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:46.844443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7de73214-9031-4e4d-bfbb-071ce307f533 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:46.845702 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7de73214-9031-4e4d-bfbb-071ce307f533 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:46.846320 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7de73214-9031-4e4d-bfbb-071ce307f533 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:46.847033 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7de73214-9031-4e4d-bfbb-071ce307f533 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:46.914838 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-7c59cf0d-dd94-4ab4-abe4-b77078876cd0 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf4f974f1747188e46c85a3601124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c85fe65feb4b3f890372c8da841629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:46.922980 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-7c59cf0d-dd94-4ab4-abe4-b77078876cd0 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958" status: 200 len: 1298 microversion: 2.1 time: 0.154789 Aug 12 11:57:46.939520 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 482/966] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:46 2022] GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958 => generated 1298 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:46.976115 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-7de73214-9031-4e4d-bfbb-071ce307f533 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:46.984884 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-7de73214-9031-4e4d-bfbb-071ce307f533 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166" status: 200 len: 1277 microversion: 2.1 time: 0.171828 Aug 12 11:57:46.985499 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 485/967] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:46 2022] GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166 => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:47.953689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-a049fca2-5858-49f7-a312-407aa8163240 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:47.954697 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-a049fca2-5858-49f7-a312-407aa8163240 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] [instance: 5e95ad75-c242-49b4-ab5f-8777ef590958] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:47.968205 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a049fca2-5858-49f7-a312-407aa8163240 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:47.968885 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a049fca2-5858-49f7-a312-407aa8163240 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:47.969909 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a049fca2-5858-49f7-a312-407aa8163240 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:47.970650 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a049fca2-5858-49f7-a312-407aa8163240 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:47.971212 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a049fca2-5858-49f7-a312-407aa8163240 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:47.971652 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a049fca2-5858-49f7-a312-407aa8163240 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:47.992986 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.wsgi [None req-a049fca2-5858-49f7-a312-407aa8163240 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] HTTP exception thrown: Instance 5e95ad75-c242-49b4-ab5f-8777ef590958 could not be found. Aug 12 11:57:47.995662 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-a049fca2-5858-49f7-a312-407aa8163240 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Request method failure captured: Aug 12 11:57:47.995662 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958 HTTP/1.1 Aug 12 11:57:47.995662 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 11:57:47.995662 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 11:57:47.995662 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 11:57:47.995662 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 0 Aug 12 11:57:47.995662 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 11:57:47.995662 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 11:57:47.995662 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 11:57:47.995662 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 11:57:47.995662 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9kAL3bUsb5reFYNRJLu1qg0FFXBce13qvnC4WN2_ohoLejPykN8yx2-ibjL1lrPgT_LU-yYT--d6mWzKUUwrSStoSRHTwB-_P2v9LsE1JU-Tx8rifV3kgDXnh2ZDuHkB0BnDm_rv3upaxSxw8QzUyQZdonluYIUEs1_YwoD8A5mQS9U Aug 12 11:57:47.995662 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 11:57:47.995662 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 11:57:47.995662 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 11:57:47.995662 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 11:57:47.995662 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 11:57:47.995662 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 11:57:47.995662 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: e5c85fe65feb4b3f890372c8da841629 Aug 12 11:57:47.995662 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-VolumesActionsTest-1820733518 Aug 12 11:57:47.995662 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 11:57:47.995662 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 11:57:47.997316 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e5c85fe65feb4b3f890372c8da841629", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e5c85fe65feb4b3f890372c8da841629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5c85fe65feb4b3f890372c8da841629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5c85fe65feb4b3f890372c8da841629"}]}] Aug 12 11:57:47.997316 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-VolumesActionsTest-1820733518 Aug 12 11:57:47.997316 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: e5c85fe65feb4b3f890372c8da841629 Aug 12 11:57:47.997316 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-VolumesActionsTest-1820733518 Aug 12 11:57:47.997316 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-VolumesActionsTest-1820733518-project Aug 12 11:57:47.997316 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 11:57:47.997316 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 11:57:47.997316 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: bdbf4f974f1747188e46c85a3601124a Aug 12 11:57:47.997316 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-VolumesActionsTest-1820733518-project Aug 12 11:57:47.997316 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: > Aug 12 11:57:47.997316 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Instance 5e95ad75-c242-49b4-ab5f-8777ef590958 could not be found. Aug 12 11:57:47.997316 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'id': '5e95ad75-c242-49b4-ab5f-8777ef590958'} Aug 12 11:57:47.998090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:57:47.998090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:57:47.998090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:57:47.998090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:57:47.998090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:57:47.998090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:57:47.998090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:57:47.998090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:57:47.998090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:57:47.998090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:57:47.998090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e95ad75-c242-49b4-ab5f-8777ef590958 could not be found. Aug 12 11:57:47.998090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:57:47.998090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:57:47.998090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:57:47.998090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:57:47.998090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:57:47.998090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:57:47.998090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:57:47.998090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:57:47.998090 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:57:47.999456 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:57:47.999456 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:57:47.999456 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:57:47.999456 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:57:47.999456 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:57:47.999456 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:57:47.999456 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:57:47.999456 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e95ad75-c242-49b4-ab5f-8777ef590958 could not be found. Aug 12 11:57:47.999456 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:57:47.999456 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:57:47.999456 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:57:47.999456 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:57:47.999456 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:57:47.999456 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:57:47.999456 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:57:47.999456 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:57:47.999456 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e95ad75-c242-49b4-ab5f-8777ef590958 could not be found. Aug 12 11:57:47.999456 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:57:48.006540 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-a049fca2-5858-49f7-a312-407aa8163240 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] Returning 404 to user: Instance 5e95ad75-c242-49b4-ab5f-8777ef590958 could not be found. {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:57:48.007528 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-a049fca2-5858-49f7-a312-407aa8163240 tempest-VolumesActionsTest-1820733518 tempest-VolumesActionsTest-1820733518-project] 10.222.0.42 "GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958" status: 404 len: 111 microversion: 2.1 time: 0.060426 Aug 12 11:57:48.008194 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 483/968] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:47 2022] GET /compute/v2.1/servers/5e95ad75-c242-49b4-ab5f-8777ef590958 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:57:48.009167 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-a9e7cbb7-e4aa-4fc2-a0c7-f03ec48b821c tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:48.009772 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-a9e7cbb7-e4aa-4fc2-a0c7-f03ec48b821c tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: c2402b33-5612-4061-ad76-2d3f05e9d166] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:48.028557 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:48.042281 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a9e7cbb7-e4aa-4fc2-a0c7-f03ec48b821c tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:48.043099 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a9e7cbb7-e4aa-4fc2-a0c7-f03ec48b821c tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:48.043686 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a9e7cbb7-e4aa-4fc2-a0c7-f03ec48b821c tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:48.044640 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a9e7cbb7-e4aa-4fc2-a0c7-f03ec48b821c tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:48.045248 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a9e7cbb7-e4aa-4fc2-a0c7-f03ec48b821c tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:48.045849 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a9e7cbb7-e4aa-4fc2-a0c7-f03ec48b821c tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:48.475703 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-a9e7cbb7-e4aa-4fc2-a0c7-f03ec48b821c tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:48.502150 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-a9e7cbb7-e4aa-4fc2-a0c7-f03ec48b821c tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166" status: 200 len: 1319 microversion: 2.1 time: 0.497365 Aug 12 11:57:48.506182 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 486/969] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:48 2022] GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166 => generated 1319 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:48.810953 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-89e1cfc5-dfab-44db-bd8e-9bdf18d6ba86 req-5708da06-3887-43d5-8da9-a2acece1cfca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2402b33-5612-4061-ad76-2d3f05e9d166", "tag": "a216bdf5-9b06-4a5f-8eb2-7df540248f7c"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:57:48.830287 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-89e1cfc5-dfab-44db-bd8e-9bdf18d6ba86 req-5708da06-3887-43d5-8da9-a2acece1cfca service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:48.833534 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-89e1cfc5-dfab-44db-bd8e-9bdf18d6ba86 req-5708da06-3887-43d5-8da9-a2acece1cfca service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:48.834221 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-89e1cfc5-dfab-44db-bd8e-9bdf18d6ba86 req-5708da06-3887-43d5-8da9-a2acece1cfca service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:48.869047 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-89e1cfc5-dfab-44db-bd8e-9bdf18d6ba86 req-5708da06-3887-43d5-8da9-a2acece1cfca service nova] Creating event network-changed:a216bdf5-9b06-4a5f-8eb2-7df540248f7c for instance c2402b33-5612-4061-ad76-2d3f05e9d166 on hv-cinder-85282 Aug 12 11:57:48.884432 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-89e1cfc5-dfab-44db-bd8e-9bdf18d6ba86 req-5708da06-3887-43d5-8da9-a2acece1cfca service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078531 Aug 12 11:57:48.888802 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 484/970] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:57:49.531383 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-3f6de16f-670b-4fd9-8b76-29392814b499 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:49.532608 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-3f6de16f-670b-4fd9-8b76-29392814b499 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: c2402b33-5612-4061-ad76-2d3f05e9d166] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:49.543131 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3f6de16f-670b-4fd9-8b76-29392814b499 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:49.544161 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3f6de16f-670b-4fd9-8b76-29392814b499 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:49.544601 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3f6de16f-670b-4fd9-8b76-29392814b499 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:49.545345 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3f6de16f-670b-4fd9-8b76-29392814b499 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:49.545796 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3f6de16f-670b-4fd9-8b76-29392814b499 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:49.546405 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3f6de16f-670b-4fd9-8b76-29392814b499 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:49.925654 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-3f6de16f-670b-4fd9-8b76-29392814b499 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:49.937554 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-3f6de16f-670b-4fd9-8b76-29392814b499 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166" status: 200 len: 1319 microversion: 2.1 time: 0.414025 Aug 12 11:57:49.939429 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 487/971] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:49 2022] GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166 => generated 1319 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:50.966239 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-a7d53e73-86e2-4e21-a2ba-242f43f4d40f tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:50.968646 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-a7d53e73-86e2-4e21-a2ba-242f43f4d40f tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: c2402b33-5612-4061-ad76-2d3f05e9d166] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:50.976053 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a7d53e73-86e2-4e21-a2ba-242f43f4d40f tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:50.976632 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a7d53e73-86e2-4e21-a2ba-242f43f4d40f tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:50.977143 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a7d53e73-86e2-4e21-a2ba-242f43f4d40f tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:50.978117 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a7d53e73-86e2-4e21-a2ba-242f43f4d40f tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:50.978831 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a7d53e73-86e2-4e21-a2ba-242f43f4d40f tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:50.979271 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a7d53e73-86e2-4e21-a2ba-242f43f4d40f tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:51.153027 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-a7d53e73-86e2-4e21-a2ba-242f43f4d40f tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:51.175812 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-a7d53e73-86e2-4e21-a2ba-242f43f4d40f tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166" status: 200 len: 1319 microversion: 2.1 time: 0.215250 Aug 12 11:57:51.176394 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 485/972] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:50 2022] GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:52.197685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-8ec6a883-6ae8-443f-a14a-eafa1be498a6 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:52.198495 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-8ec6a883-6ae8-443f-a14a-eafa1be498a6 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: c2402b33-5612-4061-ad76-2d3f05e9d166] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:52.205001 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8ec6a883-6ae8-443f-a14a-eafa1be498a6 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:52.206504 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8ec6a883-6ae8-443f-a14a-eafa1be498a6 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:52.207049 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8ec6a883-6ae8-443f-a14a-eafa1be498a6 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:52.207816 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8ec6a883-6ae8-443f-a14a-eafa1be498a6 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:52.208401 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8ec6a883-6ae8-443f-a14a-eafa1be498a6 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:52.209004 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8ec6a883-6ae8-443f-a14a-eafa1be498a6 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:52.356089 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-8ec6a883-6ae8-443f-a14a-eafa1be498a6 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:52.364274 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-8ec6a883-6ae8-443f-a14a-eafa1be498a6 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166" status: 200 len: 1319 microversion: 2.1 time: 0.170917 Aug 12 11:57:52.365071 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 486/973] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:52 2022] GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:57:52.423019 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-7e843d06-9188-4fc9-9993-2cbaa4db1798 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Action: 'create', calling method: .version_select at 0x7f3e58319280>, body: {"keypair": {"name": "tempest-TestShelveInstance-738393314", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOd9LZp+l8VjsBsdhTw2enNL4Kjtb2if9raJOW5tZk7X3uW4DdE7GZlkDjSK0etQE7mUCgoBiNYsvm8xQLvhKfRcHfrC1fv7mU68eoeAEVej6UiOkYzXvbdiob6PRk9H+A=="}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:57:52.463016 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.quota [None req-7e843d06-9188-4fc9-9993-2cbaa4db1798 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Getting quotas for project 42c8262170e04920ae36e89e24656f7d. Resources: {'key_pairs'} {{(pid=132281) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:57:52.467430 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.quota [None req-7e843d06-9188-4fc9-9993-2cbaa4db1798 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Getting quotas for user 4974aee8a8724bcd8278cd1fc8736b05 and project 42c8262170e04920ae36e89e24656f7d. Resources: {'key_pairs'} {{(pid=132281) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:57:52.497021 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-7e843d06-9188-4fc9-9993-2cbaa4db1798 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.308154 Aug 12 11:57:52.502935 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 488/974] 10.222.0.42 () {60 vars in 1159 bytes} [Fri Aug 12 11:57:52 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:57:53.386133 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-9d2ffb93-2b2a-46e9-967c-4d1480b38b14 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:53.386821 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-9d2ffb93-2b2a-46e9-967c-4d1480b38b14 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: c2402b33-5612-4061-ad76-2d3f05e9d166] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:53.403434 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9d2ffb93-2b2a-46e9-967c-4d1480b38b14 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:53.404324 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9d2ffb93-2b2a-46e9-967c-4d1480b38b14 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:53.405263 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9d2ffb93-2b2a-46e9-967c-4d1480b38b14 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:53.407345 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9d2ffb93-2b2a-46e9-967c-4d1480b38b14 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:53.408161 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9d2ffb93-2b2a-46e9-967c-4d1480b38b14 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:53.408730 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9d2ffb93-2b2a-46e9-967c-4d1480b38b14 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:53.601242 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-9d2ffb93-2b2a-46e9-967c-4d1480b38b14 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:53.615729 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-9d2ffb93-2b2a-46e9-967c-4d1480b38b14 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166" status: 200 len: 1319 microversion: 2.1 time: 0.233122 Aug 12 11:57:53.616501 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 487/975] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:53 2022] GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:54.637663 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-4dc91891-9a5e-4391-8677-7d36a5b02341 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:54.638954 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-4dc91891-9a5e-4391-8677-7d36a5b02341 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: c2402b33-5612-4061-ad76-2d3f05e9d166] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:54.642040 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell0:SELECT=2 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:54.649131 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4dc91891-9a5e-4391-8677-7d36a5b02341 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:54.650475 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4dc91891-9a5e-4391-8677-7d36a5b02341 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:54.651016 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4dc91891-9a5e-4391-8677-7d36a5b02341 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:54.651830 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4dc91891-9a5e-4391-8677-7d36a5b02341 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:54.652519 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4dc91891-9a5e-4391-8677-7d36a5b02341 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:54.653186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4dc91891-9a5e-4391-8677-7d36a5b02341 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:54.887508 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-4dc91891-9a5e-4391-8677-7d36a5b02341 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:54.911628 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-4dc91891-9a5e-4391-8677-7d36a5b02341 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166" status: 200 len: 1319 microversion: 2.1 time: 0.278253 Aug 12 11:57:54.932447 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 489/976] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:54 2022] GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166 => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:55.943144 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-4404d766-5c6b-4afd-899a-207da5771329 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:55.943745 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-4404d766-5c6b-4afd-899a-207da5771329 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: c2402b33-5612-4061-ad76-2d3f05e9d166] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:55.945943 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=2 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:55.954838 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4404d766-5c6b-4afd-899a-207da5771329 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:55.955606 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4404d766-5c6b-4afd-899a-207da5771329 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:55.956205 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4404d766-5c6b-4afd-899a-207da5771329 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:55.957078 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4404d766-5c6b-4afd-899a-207da5771329 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:55.957538 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4404d766-5c6b-4afd-899a-207da5771329 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:55.958147 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4404d766-5c6b-4afd-899a-207da5771329 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:56.126101 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-4404d766-5c6b-4afd-899a-207da5771329 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:56.139164 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-4404d766-5c6b-4afd-899a-207da5771329 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166" status: 200 len: 1319 microversion: 2.1 time: 0.201271 Aug 12 11:57:56.139814 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 488/977] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:55 2022] GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:56.728560 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-4966679c-0b31-478a-ab8d-d861f498507d req-1228fe09-8a66-48bd-9d54-a8900f71251d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2402b33-5612-4061-ad76-2d3f05e9d166", "name": "network-vif-plugged", "status": "completed", "tag": "a216bdf5-9b06-4a5f-8eb2-7df540248f7c"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:57:56.749147 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-4966679c-0b31-478a-ab8d-d861f498507d req-1228fe09-8a66-48bd-9d54-a8900f71251d service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:56.751575 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-4966679c-0b31-478a-ab8d-d861f498507d req-1228fe09-8a66-48bd-9d54-a8900f71251d service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:56.752275 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-4966679c-0b31-478a-ab8d-d861f498507d req-1228fe09-8a66-48bd-9d54-a8900f71251d service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:56.768948 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-4966679c-0b31-478a-ab8d-d861f498507d req-1228fe09-8a66-48bd-9d54-a8900f71251d service nova] Creating event network-vif-plugged:a216bdf5-9b06-4a5f-8eb2-7df540248f7c for instance c2402b33-5612-4061-ad76-2d3f05e9d166 on hv-cinder-85282 Aug 12 11:57:56.781299 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-4966679c-0b31-478a-ab8d-d861f498507d req-1228fe09-8a66-48bd-9d54-a8900f71251d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057437 Aug 12 11:57:56.783528 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 490/978] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:57:57.169230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-05c066d3-d771-4726-9468-57809658cd0e tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:57.170479 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-05c066d3-d771-4726-9468-57809658cd0e tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: c2402b33-5612-4061-ad76-2d3f05e9d166] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:57.178114 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-05c066d3-d771-4726-9468-57809658cd0e tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:57.178596 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-05c066d3-d771-4726-9468-57809658cd0e tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:57.179085 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-05c066d3-d771-4726-9468-57809658cd0e tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:57.179821 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-05c066d3-d771-4726-9468-57809658cd0e tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:57.180324 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-05c066d3-d771-4726-9468-57809658cd0e tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:57.180939 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-05c066d3-d771-4726-9468-57809658cd0e tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:57.336911 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-05c066d3-d771-4726-9468-57809658cd0e tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:57.346398 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-05c066d3-d771-4726-9468-57809658cd0e tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166" status: 200 len: 1319 microversion: 2.1 time: 0.181920 Aug 12 11:57:57.347068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 489/979] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:57 2022] GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:57:58.371063 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-7fc91dd4-bf52-4f67-bcbe-479f7af35fa3 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:58.372522 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-7fc91dd4-bf52-4f67-bcbe-479f7af35fa3 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: c2402b33-5612-4061-ad76-2d3f05e9d166] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:58.381582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7fc91dd4-bf52-4f67-bcbe-479f7af35fa3 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:58.382895 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7fc91dd4-bf52-4f67-bcbe-479f7af35fa3 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:58.383418 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7fc91dd4-bf52-4f67-bcbe-479f7af35fa3 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:58.384440 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7fc91dd4-bf52-4f67-bcbe-479f7af35fa3 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:58.385308 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7fc91dd4-bf52-4f67-bcbe-479f7af35fa3 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:58.385737 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7fc91dd4-bf52-4f67-bcbe-479f7af35fa3 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:58.573342 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-7fc91dd4-bf52-4f67-bcbe-479f7af35fa3 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:58.584972 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-7fc91dd4-bf52-4f67-bcbe-479f7af35fa3 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166" status: 200 len: 1319 microversion: 2.1 time: 0.218997 Aug 12 11:57:58.588536 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 491/980] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:58 2022] GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:57:59.609494 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-28c3c3ef-6167-481c-b8fb-1404c9087b9b tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:57:59.610287 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-28c3c3ef-6167-481c-b8fb-1404c9087b9b tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: c2402b33-5612-4061-ad76-2d3f05e9d166] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:59.634138 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-28c3c3ef-6167-481c-b8fb-1404c9087b9b tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:59.636343 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-28c3c3ef-6167-481c-b8fb-1404c9087b9b tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:59.638108 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-28c3c3ef-6167-481c-b8fb-1404c9087b9b tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:59.639873 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-28c3c3ef-6167-481c-b8fb-1404c9087b9b tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:59.640800 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-28c3c3ef-6167-481c-b8fb-1404c9087b9b tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:59.641459 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-28c3c3ef-6167-481c-b8fb-1404c9087b9b tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:59.650827 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:59.815449 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-28c3c3ef-6167-481c-b8fb-1404c9087b9b tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:57:59.823041 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-28c3c3ef-6167-481c-b8fb-1404c9087b9b tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166" status: 200 len: 1507 microversion: 2.1 time: 0.217618 Aug 12 11:57:59.823594 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 490/981] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:57:59 2022] GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166 => generated 1507 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:57:59.846187 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-bf5b9a7e-39b1-4946-81cf-1081d0792332 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f934f5ce-84e2-45d1-88e0-f7cfa973d355", "device": "/dev/sdb"}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:57:59.851745 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-bf5b9a7e-39b1-4946-81cf-1081d0792332 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: c2402b33-5612-4061-ad76-2d3f05e9d166] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:57:59.866455 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bf5b9a7e-39b1-4946-81cf-1081d0792332 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:59.867003 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bf5b9a7e-39b1-4946-81cf-1081d0792332 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:59.867441 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bf5b9a7e-39b1-4946-81cf-1081d0792332 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:57:59.868157 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bf5b9a7e-39b1-4946-81cf-1081d0792332 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:57:59.869089 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bf5b9a7e-39b1-4946-81cf-1081d0792332 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:57:59.869718 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bf5b9a7e-39b1-4946-81cf-1081d0792332 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:00.254501 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-bf5b9a7e-39b1-4946-81cf-1081d0792332 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "POST /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.412696 Aug 12 11:58:00.255431 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 492/982] 10.222.0.42 () {60 vars in 1323 bytes} [Fri Aug 12 11:57:59 2022] POST /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166/os-volume_attachments => generated 194 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:58:08.069543 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 11:58:08.070394 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Fri Aug 12 11:58:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 11:58:18.715718 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-b4171eb9-34a8-496e-9b6b-aee39d0b2156 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-307366366", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-738393314", "security_groups": [{"name": "tempest-secgroup-smoke-1203172296"}], "networks": [{"uuid": "6eb68ad3-1fa8-4ead-94c0-ad99601be5bf"}], "block_device_mapping_v2": [{"uuid": "41fe1ad8-f0c3-4534-9b9c-bebd5138a85a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:58:18.743623 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:18.744308 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=5 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:18.864007 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.network.neutron [None req-b4171eb9-34a8-496e-9b6b-aee39d0b2156 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] validate_networks() for [('6eb68ad3-1fa8-4ead-94c0-ad99601be5bf', None, None, None, None, None)] {{(pid=132282) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 11:58:19.358215 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-b4171eb9-34a8-496e-9b6b-aee39d0b2156 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Flavor limits 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 11:58:19.358734 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-b4171eb9-34a8-496e-9b6b-aee39d0b2156 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Image limits 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 11:58:19.359212 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-b4171eb9-34a8-496e-9b6b-aee39d0b2156 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Flavor pref 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 11:58:19.359621 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-b4171eb9-34a8-496e-9b6b-aee39d0b2156 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Image pref 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 11:58:19.360030 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-b4171eb9-34a8-496e-9b6b-aee39d0b2156 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 11:58:19.369519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b4171eb9-34a8-496e-9b6b-aee39d0b2156 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:19.369939 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b4171eb9-34a8-496e-9b6b-aee39d0b2156 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:19.370374 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b4171eb9-34a8-496e-9b6b-aee39d0b2156 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:19.371135 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b4171eb9-34a8-496e-9b6b-aee39d0b2156 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:19.371587 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b4171eb9-34a8-496e-9b6b-aee39d0b2156 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:19.372017 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b4171eb9-34a8-496e-9b6b-aee39d0b2156 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:19.389317 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-b4171eb9-34a8-496e-9b6b-aee39d0b2156 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Getting quotas for project 42c8262170e04920ae36e89e24656f7d. Resources: {'instances', 'ram', 'cores'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:58:19.393578 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-b4171eb9-34a8-496e-9b6b-aee39d0b2156 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Getting quotas for user 4974aee8a8724bcd8278cd1fc8736b05 and project 42c8262170e04920ae36e89e24656f7d. Resources: {'instances', 'ram', 'cores'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:58:19.452255 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-b4171eb9-34a8-496e-9b6b-aee39d0b2156 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Going to run 1 instances... {{(pid=132282) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 11:58:19.454494 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-b4171eb9-34a8-496e-9b6b-aee39d0b2156 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='41fe1ad8-f0c3-4534-9b9c-bebd5138a85a',volume_size=None,volume_type=None)] {{(pid=132282) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 11:58:19.589316 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-b4171eb9-34a8-496e-9b6b-aee39d0b2156 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.881434 Aug 12 11:58:19.590048 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 491/983] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Aug 12 11:58:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 11:58:19.598344 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell0:SELECT=10 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:19.599691 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:19.600351 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:19.604381 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-aecbe45e-875b-48e3-825b-59cb9fd7d0af tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:19.605079 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-aecbe45e-875b-48e3-825b-59cb9fd7d0af tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:19.668214 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-aecbe45e-875b-48e3-825b-59cb9fd7d0af tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:58:19.676286 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-aecbe45e-875b-48e3-825b-59cb9fd7d0af tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1087 microversion: 2.1 time: 0.079289 Aug 12 11:58:19.677785 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 493/984] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:58:19 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1087 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:58:19.977693 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-8684fd09-e61c-4510-898e-2cbe1c061adf tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:19.978246 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-8684fd09-e61c-4510-898e-2cbe1c061adf tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: c2402b33-5612-4061-ad76-2d3f05e9d166] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:19.985422 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8684fd09-e61c-4510-898e-2cbe1c061adf tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:19.985653 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8684fd09-e61c-4510-898e-2cbe1c061adf tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:19.986088 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8684fd09-e61c-4510-898e-2cbe1c061adf tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:19.986841 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8684fd09-e61c-4510-898e-2cbe1c061adf tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:19.987295 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8684fd09-e61c-4510-898e-2cbe1c061adf tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:19.987714 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8684fd09-e61c-4510-898e-2cbe1c061adf tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:20.070933 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.objects.instance [None req-8684fd09-e61c-4510-898e-2cbe1c061adf tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lazy-loading 'services' on Instance uuid c2402b33-5612-4061-ad76-2d3f05e9d166 {{(pid=132282) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:58:20.151830 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-8684fd09-e61c-4510-898e-2cbe1c061adf tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166/os-volume_attachments/f934f5ce-84e2-45d1-88e0-f7cfa973d355" status: 202 len: 0 microversion: 2.1 time: 0.179209 Aug 12 11:58:20.152413 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 492/985] 10.222.0.42 () {58 vars in 1416 bytes} [Fri Aug 12 11:58:19 2022] DELETE /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166/os-volume_attachments/f934f5ce-84e2-45d1-88e0-f7cfa973d355 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:58:20.698872 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-edc7f458-11c3-4c6c-af51-dbcdd2806c7f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:20.699476 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-edc7f458-11c3-4c6c-af51-dbcdd2806c7f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:20.706706 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-edc7f458-11c3-4c6c-af51-dbcdd2806c7f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:20.707180 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-edc7f458-11c3-4c6c-af51-dbcdd2806c7f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:20.707603 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-edc7f458-11c3-4c6c-af51-dbcdd2806c7f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:20.708281 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-edc7f458-11c3-4c6c-af51-dbcdd2806c7f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:20.708729 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-edc7f458-11c3-4c6c-af51-dbcdd2806c7f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:20.709142 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-edc7f458-11c3-4c6c-af51-dbcdd2806c7f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:20.772131 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-edc7f458-11c3-4c6c-af51-dbcdd2806c7f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:58:20.780212 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-edc7f458-11c3-4c6c-af51-dbcdd2806c7f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1185 microversion: 2.1 time: 0.085704 Aug 12 11:58:20.780757 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 494/986] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:58:20 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:58:21.286092 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-4006024a-62e4-45bc-aa2c-b636f782d188 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:21.287313 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-4006024a-62e4-45bc-aa2c-b636f782d188 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: c2402b33-5612-4061-ad76-2d3f05e9d166] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:21.293896 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4006024a-62e4-45bc-aa2c-b636f782d188 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:21.294556 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4006024a-62e4-45bc-aa2c-b636f782d188 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:21.295194 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4006024a-62e4-45bc-aa2c-b636f782d188 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:21.296208 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4006024a-62e4-45bc-aa2c-b636f782d188 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:21.296658 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4006024a-62e4-45bc-aa2c-b636f782d188 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:21.297259 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4006024a-62e4-45bc-aa2c-b636f782d188 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:21.326626 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-4006024a-62e4-45bc-aa2c-b636f782d188 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: c2402b33-5612-4061-ad76-2d3f05e9d166] Going to try to terminate instance {{(pid=132282) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 11:58:21.420267 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-4006024a-62e4-45bc-aa2c-b636f782d188 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166" status: 204 len: 0 microversion: 2.1 time: 0.138130 Aug 12 11:58:21.420948 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 493/987] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Aug 12 11:58:21 2022] DELETE /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 11:58:21.429968 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-eee6aae7-a9ec-48d5-85b2-abc685cd8697 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:21.431039 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-eee6aae7-a9ec-48d5-85b2-abc685cd8697 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: c2402b33-5612-4061-ad76-2d3f05e9d166] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:21.437910 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-eee6aae7-a9ec-48d5-85b2-abc685cd8697 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:21.439563 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-eee6aae7-a9ec-48d5-85b2-abc685cd8697 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:21.445327 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-eee6aae7-a9ec-48d5-85b2-abc685cd8697 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:21.446222 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-eee6aae7-a9ec-48d5-85b2-abc685cd8697 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:21.447093 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-eee6aae7-a9ec-48d5-85b2-abc685cd8697 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:21.447723 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-eee6aae7-a9ec-48d5-85b2-abc685cd8697 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:21.591677 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-eee6aae7-a9ec-48d5-85b2-abc685cd8697 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:58:21.599159 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-eee6aae7-a9ec-48d5-85b2-abc685cd8697 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166" status: 200 len: 1513 microversion: 2.1 time: 0.173802 Aug 12 11:58:21.599725 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 495/988] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:58:21 2022] GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166 => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:58:21.801679 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-6add3d1d-4ba5-4b8c-b444-553857c9933b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:21.802286 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-6add3d1d-4ba5-4b8c-b444-553857c9933b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:21.808228 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6add3d1d-4ba5-4b8c-b444-553857c9933b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:21.808709 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6add3d1d-4ba5-4b8c-b444-553857c9933b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:21.809146 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6add3d1d-4ba5-4b8c-b444-553857c9933b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:21.809829 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6add3d1d-4ba5-4b8c-b444-553857c9933b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:21.810282 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6add3d1d-4ba5-4b8c-b444-553857c9933b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:21.810731 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6add3d1d-4ba5-4b8c-b444-553857c9933b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:21.872760 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-6add3d1d-4ba5-4b8c-b444-553857c9933b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:58:21.880276 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-6add3d1d-4ba5-4b8c-b444-553857c9933b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1203 microversion: 2.1 time: 0.082898 Aug 12 11:58:21.880826 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 494/989] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:58:21 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1203 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:58:22.620870 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-f2e12577-f290-4f36-8e1f-28ac46606601 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:22.621478 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-f2e12577-f290-4f36-8e1f-28ac46606601 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: c2402b33-5612-4061-ad76-2d3f05e9d166] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:22.627997 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f2e12577-f290-4f36-8e1f-28ac46606601 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:22.628479 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f2e12577-f290-4f36-8e1f-28ac46606601 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:22.628909 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f2e12577-f290-4f36-8e1f-28ac46606601 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:22.629594 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f2e12577-f290-4f36-8e1f-28ac46606601 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:22.630044 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f2e12577-f290-4f36-8e1f-28ac46606601 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:22.630468 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f2e12577-f290-4f36-8e1f-28ac46606601 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:22.766310 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-f2e12577-f290-4f36-8e1f-28ac46606601 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:58:22.774841 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-f2e12577-f290-4f36-8e1f-28ac46606601 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166" status: 200 len: 1513 microversion: 2.1 time: 0.158262 Aug 12 11:58:22.775671 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 496/990] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:58:22 2022] GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:58:22.901071 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-b50dca36-13cd-4584-bbae-5d1f58bde39c tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:22.901727 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-b50dca36-13cd-4584-bbae-5d1f58bde39c tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:22.908303 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b50dca36-13cd-4584-bbae-5d1f58bde39c tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:22.908782 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b50dca36-13cd-4584-bbae-5d1f58bde39c tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:22.909212 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b50dca36-13cd-4584-bbae-5d1f58bde39c tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:22.909911 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b50dca36-13cd-4584-bbae-5d1f58bde39c tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:22.910353 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b50dca36-13cd-4584-bbae-5d1f58bde39c tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:22.910804 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b50dca36-13cd-4584-bbae-5d1f58bde39c tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:22.973634 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-b50dca36-13cd-4584-bbae-5d1f58bde39c tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:58:22.983650 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-b50dca36-13cd-4584-bbae-5d1f58bde39c tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1203 microversion: 2.1 time: 0.086548 Aug 12 11:58:22.984694 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 495/991] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:58:22 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1203 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:58:23.798495 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-5ba3505b-ee47-40cd-9fda-b239e807a78b tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:23.799950 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-5ba3505b-ee47-40cd-9fda-b239e807a78b tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: c2402b33-5612-4061-ad76-2d3f05e9d166] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:23.807246 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5ba3505b-ee47-40cd-9fda-b239e807a78b tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:23.808010 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5ba3505b-ee47-40cd-9fda-b239e807a78b tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:23.808450 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5ba3505b-ee47-40cd-9fda-b239e807a78b tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:23.809152 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5ba3505b-ee47-40cd-9fda-b239e807a78b tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:23.809603 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5ba3505b-ee47-40cd-9fda-b239e807a78b tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:23.810028 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5ba3505b-ee47-40cd-9fda-b239e807a78b tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:24.005540 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-7e25f4a9-e5ca-47f2-a918-a0e186951574 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:24.006094 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-7e25f4a9-e5ca-47f2-a918-a0e186951574 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:24.012993 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7e25f4a9-e5ca-47f2-a918-a0e186951574 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:24.013479 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7e25f4a9-e5ca-47f2-a918-a0e186951574 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:24.013918 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7e25f4a9-e5ca-47f2-a918-a0e186951574 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:24.014630 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7e25f4a9-e5ca-47f2-a918-a0e186951574 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:24.015080 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7e25f4a9-e5ca-47f2-a918-a0e186951574 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:24.015503 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7e25f4a9-e5ca-47f2-a918-a0e186951574 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:24.211115 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-5ba3505b-ee47-40cd-9fda-b239e807a78b tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddb84a8b734c70b7b55685a1a12f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c66a0584e9345c392d95524bdcc7f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:58:24.218658 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-5ba3505b-ee47-40cd-9fda-b239e807a78b tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166" status: 200 len: 1513 microversion: 2.1 time: 0.424221 Aug 12 11:58:24.219225 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 497/992] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:58:23 2022] GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166 => generated 1513 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:58:24.330296 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-7e25f4a9-e5ca-47f2-a918-a0e186951574 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:58:24.341876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-7e25f4a9-e5ca-47f2-a918-a0e186951574 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1259 microversion: 2.1 time: 0.340155 Aug 12 11:58:24.342453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 496/993] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:58:24 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1259 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:58:24.504171 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-c4c89340-74b8-4b7b-8922-bdb93a4ef01c req-3742fadd-a9bd-436b-8572-139d483d1cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2402b33-5612-4061-ad76-2d3f05e9d166", "name": "network-vif-deleted", "tag": "a216bdf5-9b06-4a5f-8eb2-7df540248f7c"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:58:24.513721 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-c4c89340-74b8-4b7b-8922-bdb93a4ef01c req-3742fadd-a9bd-436b-8572-139d483d1cb6 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:24.514198 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-c4c89340-74b8-4b7b-8922-bdb93a4ef01c req-3742fadd-a9bd-436b-8572-139d483d1cb6 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:24.514639 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-c4c89340-74b8-4b7b-8922-bdb93a4ef01c req-3742fadd-a9bd-436b-8572-139d483d1cb6 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:24.527096 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-c4c89340-74b8-4b7b-8922-bdb93a4ef01c req-3742fadd-a9bd-436b-8572-139d483d1cb6 service nova] Creating event network-vif-deleted:a216bdf5-9b06-4a5f-8eb2-7df540248f7c for instance c2402b33-5612-4061-ad76-2d3f05e9d166 on hv-cinder-85282 Aug 12 11:58:24.532878 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-c4c89340-74b8-4b7b-8922-bdb93a4ef01c req-3742fadd-a9bd-436b-8572-139d483d1cb6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032559 Aug 12 11:58:24.533642 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 498/994] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:58:25.240457 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-1a888ddc-60c7-4a4e-8b82-ac662e0b0c26 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:25.241212 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-1a888ddc-60c7-4a4e-8b82-ac662e0b0c26 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] [instance: c2402b33-5612-4061-ad76-2d3f05e9d166] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:25.249264 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1a888ddc-60c7-4a4e-8b82-ac662e0b0c26 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:25.249888 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1a888ddc-60c7-4a4e-8b82-ac662e0b0c26 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:25.250319 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1a888ddc-60c7-4a4e-8b82-ac662e0b0c26 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:25.251050 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1a888ddc-60c7-4a4e-8b82-ac662e0b0c26 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:25.251501 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1a888ddc-60c7-4a4e-8b82-ac662e0b0c26 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:25.251920 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-1a888ddc-60c7-4a4e-8b82-ac662e0b0c26 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:25.265820 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.wsgi [None req-1a888ddc-60c7-4a4e-8b82-ac662e0b0c26 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] HTTP exception thrown: Instance c2402b33-5612-4061-ad76-2d3f05e9d166 could not be found. Aug 12 11:58:25.267501 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-1a888ddc-60c7-4a4e-8b82-ac662e0b0c26 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Request method failure captured: Aug 12 11:58:25.267501 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166 HTTP/1.1 Aug 12 11:58:25.267501 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 11:58:25.267501 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 11:58:25.267501 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 11:58:25.267501 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 0 Aug 12 11:58:25.267501 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 11:58:25.267501 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 11:58:25.267501 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 11:58:25.267501 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 11:58:25.267501 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9j_wjMgo4WpUMqMDFOF-4x_zOU-JRbfj4dc9Yw9rki2TNjWo2Prw_ifYqfu_11zlK-OWJ3HqAuW5LII8k4s4rL6BhPt-p1ySeOoqol2t3W_sfh6Aopcy45BNkWgr0-8ckSMI4UgaBPQMcRu4AxnU3PhTSgZsxlzmxUE6cBXyhdZetmA Aug 12 11:58:25.267501 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 11:58:25.267501 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 11:58:25.267501 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 11:58:25.267501 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 11:58:25.267501 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 11:58:25.267501 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 11:58:25.267501 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: 8c66a0584e9345c392d95524bdcc7f16 Aug 12 11:58:25.267501 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-VolumesSnapshotTestJSON-311631556 Aug 12 11:58:25.267501 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 11:58:25.267501 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 11:58:25.269046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8c66a0584e9345c392d95524bdcc7f16", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8c66a0584e9345c392d95524bdcc7f16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8c66a0584e9345c392d95524bdcc7f16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8c66a0584e9345c392d95524bdcc7f16"}]}] Aug 12 11:58:25.269046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-VolumesSnapshotTestJSON-311631556 Aug 12 11:58:25.269046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: 8c66a0584e9345c392d95524bdcc7f16 Aug 12 11:58:25.269046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-311631556 Aug 12 11:58:25.269046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-VolumesSnapshotTestJSON-311631556-project Aug 12 11:58:25.269046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 11:58:25.269046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 11:58:25.269046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: 10ddb84a8b734c70b7b55685a1a12f95 Aug 12 11:58:25.269046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-VolumesSnapshotTestJSON-311631556-project Aug 12 11:58:25.269046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: > Aug 12 11:58:25.269046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Instance c2402b33-5612-4061-ad76-2d3f05e9d166 could not be found. Aug 12 11:58:25.269046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'id': 'c2402b33-5612-4061-ad76-2d3f05e9d166'} Aug 12 11:58:25.269843 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:58:25.269843 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:58:25.269843 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:58:25.269843 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:58:25.269843 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:58:25.269843 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:58:25.269843 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:58:25.269843 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:58:25.269843 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:58:25.269843 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:58:25.269843 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2402b33-5612-4061-ad76-2d3f05e9d166 could not be found. Aug 12 11:58:25.269843 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:58:25.269843 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:58:25.269843 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:58:25.269843 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:58:25.269843 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:58:25.269843 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:58:25.269843 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:58:25.269843 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:58:25.269843 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:58:25.271335 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:58:25.271335 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:58:25.271335 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:58:25.271335 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:58:25.271335 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:58:25.271335 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:58:25.271335 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:58:25.271335 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2402b33-5612-4061-ad76-2d3f05e9d166 could not be found. Aug 12 11:58:25.271335 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:58:25.271335 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:58:25.271335 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:58:25.271335 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:58:25.271335 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:58:25.271335 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:58:25.271335 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:58:25.271335 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:58:25.271335 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2402b33-5612-4061-ad76-2d3f05e9d166 could not be found. Aug 12 11:58:25.271335 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 11:58:25.272561 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-1a888ddc-60c7-4a4e-8b82-ac662e0b0c26 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] Returning 404 to user: Instance c2402b33-5612-4061-ad76-2d3f05e9d166 could not be found. {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:58:25.272561 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-1a888ddc-60c7-4a4e-8b82-ac662e0b0c26 tempest-VolumesSnapshotTestJSON-311631556 tempest-VolumesSnapshotTestJSON-311631556-project] 10.222.0.42 "GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166" status: 404 len: 111 microversion: 2.1 time: 0.032732 Aug 12 11:58:25.272561 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 497/995] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:58:25 2022] GET /compute/v2.1/servers/c2402b33-5612-4061-ad76-2d3f05e9d166 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:58:25.363721 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-6c7c9654-efee-44e7-8c9a-9ebafbdca25b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:25.364418 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-6c7c9654-efee-44e7-8c9a-9ebafbdca25b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:25.371581 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6c7c9654-efee-44e7-8c9a-9ebafbdca25b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:25.372336 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6c7c9654-efee-44e7-8c9a-9ebafbdca25b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:25.372936 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6c7c9654-efee-44e7-8c9a-9ebafbdca25b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:25.373813 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6c7c9654-efee-44e7-8c9a-9ebafbdca25b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:25.374466 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6c7c9654-efee-44e7-8c9a-9ebafbdca25b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:25.375022 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6c7c9654-efee-44e7-8c9a-9ebafbdca25b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:25.750502 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-6c7c9654-efee-44e7-8c9a-9ebafbdca25b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:58:25.758113 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-6c7c9654-efee-44e7-8c9a-9ebafbdca25b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1259 microversion: 2.1 time: 0.398466 Aug 12 11:58:25.759324 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 499/996] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:58:25 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1259 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:58:26.567239 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-0489fbb0-614f-4b0d-884c-90dbdfde3dde req-01ad4343-1143-4012-876d-8a894968b762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9e68aca-3dd9-485f-b14f-fc3b9face4fd", "tag": "eac729c6-2ebe-467e-bcc1-a5afd019c575"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:58:26.577408 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-0489fbb0-614f-4b0d-884c-90dbdfde3dde req-01ad4343-1143-4012-876d-8a894968b762 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:26.577877 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-0489fbb0-614f-4b0d-884c-90dbdfde3dde req-01ad4343-1143-4012-876d-8a894968b762 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:26.578302 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-0489fbb0-614f-4b0d-884c-90dbdfde3dde req-01ad4343-1143-4012-876d-8a894968b762 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:26.591731 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-0489fbb0-614f-4b0d-884c-90dbdfde3dde req-01ad4343-1143-4012-876d-8a894968b762 service nova] Creating event network-changed:eac729c6-2ebe-467e-bcc1-a5afd019c575 for instance f9e68aca-3dd9-485f-b14f-fc3b9face4fd on hv-cinder-85282 Aug 12 11:58:26.596757 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-0489fbb0-614f-4b0d-884c-90dbdfde3dde req-01ad4343-1143-4012-876d-8a894968b762 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033372 Aug 12 11:58:26.597334 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 498/997] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:58:26.780921 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-227aa11b-f39e-47d6-8c31-b93d8ac4522a tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:26.780921 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-227aa11b-f39e-47d6-8c31-b93d8ac4522a tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:26.786876 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-227aa11b-f39e-47d6-8c31-b93d8ac4522a tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:26.787371 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-227aa11b-f39e-47d6-8c31-b93d8ac4522a tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:26.787806 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-227aa11b-f39e-47d6-8c31-b93d8ac4522a tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:26.788910 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-227aa11b-f39e-47d6-8c31-b93d8ac4522a tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:26.789256 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-227aa11b-f39e-47d6-8c31-b93d8ac4522a tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:26.790215 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-227aa11b-f39e-47d6-8c31-b93d8ac4522a tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:27.039381 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-227aa11b-f39e-47d6-8c31-b93d8ac4522a tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:58:27.047886 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-227aa11b-f39e-47d6-8c31-b93d8ac4522a tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1259 microversion: 2.1 time: 0.272651 Aug 12 11:58:27.048454 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 500/998] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:58:26 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1259 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:58:28.068805 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-90771200-ae07-42c1-9243-a0434bfcc6bc tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:28.069638 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-90771200-ae07-42c1-9243-a0434bfcc6bc tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:28.077707 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-90771200-ae07-42c1-9243-a0434bfcc6bc tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:28.078233 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-90771200-ae07-42c1-9243-a0434bfcc6bc tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:28.078880 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-90771200-ae07-42c1-9243-a0434bfcc6bc tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:28.079615 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-90771200-ae07-42c1-9243-a0434bfcc6bc tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:28.080072 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-90771200-ae07-42c1-9243-a0434bfcc6bc tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:28.080500 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-90771200-ae07-42c1-9243-a0434bfcc6bc tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:28.286037 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-90771200-ae07-42c1-9243-a0434bfcc6bc tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:58:28.293865 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-90771200-ae07-42c1-9243-a0434bfcc6bc tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1259 microversion: 2.1 time: 0.229722 Aug 12 11:58:28.294410 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 499/999] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:58:28 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1259 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:58:29.314688 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-da86ad5e-9cd1-440a-8e20-e5b64b3f7c5d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:29.315308 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-da86ad5e-9cd1-440a-8e20-e5b64b3f7c5d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:29.322316 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-da86ad5e-9cd1-440a-8e20-e5b64b3f7c5d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:29.322823 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-da86ad5e-9cd1-440a-8e20-e5b64b3f7c5d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:29.323254 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-da86ad5e-9cd1-440a-8e20-e5b64b3f7c5d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:29.323928 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-da86ad5e-9cd1-440a-8e20-e5b64b3f7c5d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:29.324372 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-da86ad5e-9cd1-440a-8e20-e5b64b3f7c5d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:29.324789 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-da86ad5e-9cd1-440a-8e20-e5b64b3f7c5d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:29.457064 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-da86ad5e-9cd1-440a-8e20-e5b64b3f7c5d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:58:29.464416 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-da86ad5e-9cd1-440a-8e20-e5b64b3f7c5d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1259 microversion: 2.1 time: 0.153770 Aug 12 11:58:29.464980 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 501/1000] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:58:29 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:58:30.484833 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-6d1dd9c4-f9e6-462e-bd18-7542d2173168 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:30.485445 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-6d1dd9c4-f9e6-462e-bd18-7542d2173168 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:30.487849 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=2 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:30.488525 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=6 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:30.494464 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6d1dd9c4-f9e6-462e-bd18-7542d2173168 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:30.494962 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6d1dd9c4-f9e6-462e-bd18-7542d2173168 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:30.495394 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6d1dd9c4-f9e6-462e-bd18-7542d2173168 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:30.496086 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6d1dd9c4-f9e6-462e-bd18-7542d2173168 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:30.496654 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6d1dd9c4-f9e6-462e-bd18-7542d2173168 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:30.497102 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6d1dd9c4-f9e6-462e-bd18-7542d2173168 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:30.629655 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-6d1dd9c4-f9e6-462e-bd18-7542d2173168 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:58:30.637514 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-6d1dd9c4-f9e6-462e-bd18-7542d2173168 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1259 microversion: 2.1 time: 0.156641 Aug 12 11:58:30.638091 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 500/1001] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:58:30 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:58:31.659300 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-ebc88d54-8a85-4665-8d3c-6b129e5f390a tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:31.659967 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-ebc88d54-8a85-4665-8d3c-6b129e5f390a tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:31.661982 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell0:SELECT=2 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:31.668419 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ebc88d54-8a85-4665-8d3c-6b129e5f390a tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:31.668902 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ebc88d54-8a85-4665-8d3c-6b129e5f390a tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:31.669334 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ebc88d54-8a85-4665-8d3c-6b129e5f390a tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:31.670024 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ebc88d54-8a85-4665-8d3c-6b129e5f390a tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:31.670475 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ebc88d54-8a85-4665-8d3c-6b129e5f390a tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:31.670926 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-ebc88d54-8a85-4665-8d3c-6b129e5f390a tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:31.799464 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-ebc88d54-8a85-4665-8d3c-6b129e5f390a tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:58:31.807048 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-ebc88d54-8a85-4665-8d3c-6b129e5f390a tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1259 microversion: 2.1 time: 0.151498 Aug 12 11:58:31.807614 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 502/1002] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:58:31 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:58:32.827591 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-289133b2-ca09-4273-a888-11dc2b353e6d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:32.828193 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-289133b2-ca09-4273-a888-11dc2b353e6d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:32.834532 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-289133b2-ca09-4273-a888-11dc2b353e6d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:32.835047 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-289133b2-ca09-4273-a888-11dc2b353e6d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:32.835476 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-289133b2-ca09-4273-a888-11dc2b353e6d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:32.836155 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-289133b2-ca09-4273-a888-11dc2b353e6d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:32.836616 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-289133b2-ca09-4273-a888-11dc2b353e6d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:32.837042 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-289133b2-ca09-4273-a888-11dc2b353e6d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:32.972326 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-289133b2-ca09-4273-a888-11dc2b353e6d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:58:32.980506 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-289133b2-ca09-4273-a888-11dc2b353e6d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1259 microversion: 2.1 time: 0.156745 Aug 12 11:58:32.981068 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 501/1003] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:58:32 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:58:34.002128 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e32f86d9-ba15-42b6-9cd8-093a1ff62016 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:34.002689 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-e32f86d9-ba15-42b6-9cd8-093a1ff62016 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:34.009153 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e32f86d9-ba15-42b6-9cd8-093a1ff62016 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:34.009628 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e32f86d9-ba15-42b6-9cd8-093a1ff62016 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:34.010054 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e32f86d9-ba15-42b6-9cd8-093a1ff62016 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:34.010758 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e32f86d9-ba15-42b6-9cd8-093a1ff62016 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:34.011205 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e32f86d9-ba15-42b6-9cd8-093a1ff62016 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:34.011620 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e32f86d9-ba15-42b6-9cd8-093a1ff62016 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:34.153137 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-e32f86d9-ba15-42b6-9cd8-093a1ff62016 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:58:34.160849 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-e32f86d9-ba15-42b6-9cd8-093a1ff62016 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1259 microversion: 2.1 time: 0.162712 Aug 12 11:58:34.161403 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 503/1004] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:58:33 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:58:35.180995 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-47815e84-fe77-4300-9809-644b544bfb9f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:35.181616 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-47815e84-fe77-4300-9809-644b544bfb9f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:35.188026 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-47815e84-fe77-4300-9809-644b544bfb9f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:35.188460 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-47815e84-fe77-4300-9809-644b544bfb9f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:35.188935 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-47815e84-fe77-4300-9809-644b544bfb9f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:35.189882 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-47815e84-fe77-4300-9809-644b544bfb9f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:35.190339 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-47815e84-fe77-4300-9809-644b544bfb9f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:35.190801 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-47815e84-fe77-4300-9809-644b544bfb9f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:35.318753 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-47815e84-fe77-4300-9809-644b544bfb9f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:58:35.327017 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-47815e84-fe77-4300-9809-644b544bfb9f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1259 microversion: 2.1 time: 0.149779 Aug 12 11:58:35.327578 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 502/1005] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:58:35 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:58:36.347512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-bf999ca7-6577-4144-8f78-714abca40f43 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:36.348156 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-bf999ca7-6577-4144-8f78-714abca40f43 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:36.354865 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bf999ca7-6577-4144-8f78-714abca40f43 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:36.355342 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bf999ca7-6577-4144-8f78-714abca40f43 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:36.355775 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bf999ca7-6577-4144-8f78-714abca40f43 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:36.356458 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bf999ca7-6577-4144-8f78-714abca40f43 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:36.356914 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bf999ca7-6577-4144-8f78-714abca40f43 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:36.357333 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-bf999ca7-6577-4144-8f78-714abca40f43 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:36.489408 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-bf999ca7-6577-4144-8f78-714abca40f43 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:58:36.497379 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-bf999ca7-6577-4144-8f78-714abca40f43 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1259 microversion: 2.1 time: 0.153731 Aug 12 11:58:36.497940 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 504/1006] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:58:36 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:58:37.517755 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-8d7d02a8-6dbe-4dc7-ac38-36e2f7c3a5fc tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:37.518487 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-8d7d02a8-6dbe-4dc7-ac38-36e2f7c3a5fc tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:37.525278 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8d7d02a8-6dbe-4dc7-ac38-36e2f7c3a5fc tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:37.525762 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8d7d02a8-6dbe-4dc7-ac38-36e2f7c3a5fc tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:37.526197 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8d7d02a8-6dbe-4dc7-ac38-36e2f7c3a5fc tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:37.526919 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8d7d02a8-6dbe-4dc7-ac38-36e2f7c3a5fc tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:37.527372 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8d7d02a8-6dbe-4dc7-ac38-36e2f7c3a5fc tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:37.527795 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8d7d02a8-6dbe-4dc7-ac38-36e2f7c3a5fc tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:37.655725 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-8d7d02a8-6dbe-4dc7-ac38-36e2f7c3a5fc tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:58:37.663699 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-8d7d02a8-6dbe-4dc7-ac38-36e2f7c3a5fc tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1259 microversion: 2.1 time: 0.149718 Aug 12 11:58:37.664285 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 503/1007] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:58:37 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:58:38.684258 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-dc08e259-7990-4d2f-ba74-09ac77a2ece0 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:38.684883 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-dc08e259-7990-4d2f-ba74-09ac77a2ece0 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:38.692396 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dc08e259-7990-4d2f-ba74-09ac77a2ece0 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:38.692947 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dc08e259-7990-4d2f-ba74-09ac77a2ece0 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:38.693429 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dc08e259-7990-4d2f-ba74-09ac77a2ece0 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:38.694301 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dc08e259-7990-4d2f-ba74-09ac77a2ece0 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:38.694867 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dc08e259-7990-4d2f-ba74-09ac77a2ece0 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:38.695334 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-dc08e259-7990-4d2f-ba74-09ac77a2ece0 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:38.828576 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-dc08e259-7990-4d2f-ba74-09ac77a2ece0 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:58:38.836046 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-dc08e259-7990-4d2f-ba74-09ac77a2ece0 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1259 microversion: 2.1 time: 0.155781 Aug 12 11:58:38.836645 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 505/1008] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:58:38 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:58:39.864613 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-91ff5cd7-f8c7-45a0-acf1-a26ea13f5bbf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:39.865239 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-91ff5cd7-f8c7-45a0-acf1-a26ea13f5bbf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:39.879421 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-91ff5cd7-f8c7-45a0-acf1-a26ea13f5bbf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:39.879913 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-91ff5cd7-f8c7-45a0-acf1-a26ea13f5bbf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:39.880345 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-91ff5cd7-f8c7-45a0-acf1-a26ea13f5bbf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:39.881045 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-91ff5cd7-f8c7-45a0-acf1-a26ea13f5bbf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:39.881503 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-91ff5cd7-f8c7-45a0-acf1-a26ea13f5bbf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:39.881928 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-91ff5cd7-f8c7-45a0-acf1-a26ea13f5bbf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:40.020683 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-91ff5cd7-f8c7-45a0-acf1-a26ea13f5bbf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:58:40.028562 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-91ff5cd7-f8c7-45a0-acf1-a26ea13f5bbf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1259 microversion: 2.1 time: 0.175801 Aug 12 11:58:40.029116 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 504/1009] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:58:39 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:58:40.345819 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-db51912a-ea78-49d9-99ac-13fbef10e4a8 req-d4d2d047-868f-4aa0-b671-ebe58b9c2fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9e68aca-3dd9-485f-b14f-fc3b9face4fd", "name": "network-vif-plugged", "status": "completed", "tag": "eac729c6-2ebe-467e-bcc1-a5afd019c575"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:58:40.358451 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-db51912a-ea78-49d9-99ac-13fbef10e4a8 req-d4d2d047-868f-4aa0-b671-ebe58b9c2fce service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:40.359216 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-db51912a-ea78-49d9-99ac-13fbef10e4a8 req-d4d2d047-868f-4aa0-b671-ebe58b9c2fce service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:40.359745 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-db51912a-ea78-49d9-99ac-13fbef10e4a8 req-d4d2d047-868f-4aa0-b671-ebe58b9c2fce service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:40.372287 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-db51912a-ea78-49d9-99ac-13fbef10e4a8 req-d4d2d047-868f-4aa0-b671-ebe58b9c2fce service nova] Creating event network-vif-plugged:eac729c6-2ebe-467e-bcc1-a5afd019c575 for instance f9e68aca-3dd9-485f-b14f-fc3b9face4fd on hv-cinder-85282 Aug 12 11:58:40.377295 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-db51912a-ea78-49d9-99ac-13fbef10e4a8 req-d4d2d047-868f-4aa0-b671-ebe58b9c2fce service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035246 Aug 12 11:58:40.378076 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 506/1010] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:58:41.048514 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-aaf4380d-3b8b-433e-80d1-d0c4648cc73f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:41.049117 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-aaf4380d-3b8b-433e-80d1-d0c4648cc73f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:41.055562 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-aaf4380d-3b8b-433e-80d1-d0c4648cc73f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:41.056039 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-aaf4380d-3b8b-433e-80d1-d0c4648cc73f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:41.056466 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-aaf4380d-3b8b-433e-80d1-d0c4648cc73f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:41.057194 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-aaf4380d-3b8b-433e-80d1-d0c4648cc73f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:41.058378 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-aaf4380d-3b8b-433e-80d1-d0c4648cc73f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:41.058828 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-aaf4380d-3b8b-433e-80d1-d0c4648cc73f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:41.188307 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-aaf4380d-3b8b-433e-80d1-d0c4648cc73f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:58:41.195920 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-aaf4380d-3b8b-433e-80d1-d0c4648cc73f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1259 microversion: 2.1 time: 0.151248 Aug 12 11:58:41.196475 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 505/1011] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:58:41 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:58:42.217212 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-7cf1fda0-2a50-4d7d-a803-6207f4a9f20f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:42.218448 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-7cf1fda0-2a50-4d7d-a803-6207f4a9f20f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:42.224651 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7cf1fda0-2a50-4d7d-a803-6207f4a9f20f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:42.225134 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7cf1fda0-2a50-4d7d-a803-6207f4a9f20f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:42.225569 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7cf1fda0-2a50-4d7d-a803-6207f4a9f20f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:42.226264 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7cf1fda0-2a50-4d7d-a803-6207f4a9f20f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:42.226753 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7cf1fda0-2a50-4d7d-a803-6207f4a9f20f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:42.227175 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7cf1fda0-2a50-4d7d-a803-6207f4a9f20f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:42.358961 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-7cf1fda0-2a50-4d7d-a803-6207f4a9f20f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:58:42.367260 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-7cf1fda0-2a50-4d7d-a803-6207f4a9f20f tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1259 microversion: 2.1 time: 0.154348 Aug 12 11:58:42.367828 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 507/1012] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:58:42 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:58:43.392267 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-67290459-d400-4e92-a89f-6bb6d84cfa32 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:43.392881 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-67290459-d400-4e92-a89f-6bb6d84cfa32 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:43.399348 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-67290459-d400-4e92-a89f-6bb6d84cfa32 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:43.399838 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-67290459-d400-4e92-a89f-6bb6d84cfa32 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:43.400278 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-67290459-d400-4e92-a89f-6bb6d84cfa32 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:43.401568 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-67290459-d400-4e92-a89f-6bb6d84cfa32 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:43.402035 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-67290459-d400-4e92-a89f-6bb6d84cfa32 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:43.402465 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-67290459-d400-4e92-a89f-6bb6d84cfa32 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:43.533303 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-67290459-d400-4e92-a89f-6bb6d84cfa32 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:58:43.540719 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-67290459-d400-4e92-a89f-6bb6d84cfa32 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1259 microversion: 2.1 time: 0.152375 Aug 12 11:58:43.541280 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 506/1013] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:58:43 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:58:44.560376 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-88aa0d90-5695-4104-b19a-46394fac1002 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:44.560993 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-88aa0d90-5695-4104-b19a-46394fac1002 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:44.567671 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-88aa0d90-5695-4104-b19a-46394fac1002 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:44.568157 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-88aa0d90-5695-4104-b19a-46394fac1002 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:44.568594 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-88aa0d90-5695-4104-b19a-46394fac1002 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:44.569289 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-88aa0d90-5695-4104-b19a-46394fac1002 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:44.569752 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-88aa0d90-5695-4104-b19a-46394fac1002 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:44.570177 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-88aa0d90-5695-4104-b19a-46394fac1002 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:44.699538 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-88aa0d90-5695-4104-b19a-46394fac1002 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:58:44.707881 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-88aa0d90-5695-4104-b19a-46394fac1002 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1259 microversion: 2.1 time: 0.151336 Aug 12 11:58:44.708452 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 508/1014] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:58:44 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:58:45.728730 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-9d152483-927e-4e59-9206-4f9fff209593 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:45.729279 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-9d152483-927e-4e59-9206-4f9fff209593 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:45.735644 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9d152483-927e-4e59-9206-4f9fff209593 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:45.736118 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9d152483-927e-4e59-9206-4f9fff209593 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:45.736548 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9d152483-927e-4e59-9206-4f9fff209593 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:45.737225 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9d152483-927e-4e59-9206-4f9fff209593 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:45.737730 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9d152483-927e-4e59-9206-4f9fff209593 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:45.738147 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-9d152483-927e-4e59-9206-4f9fff209593 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:45.742074 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:45.870847 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-9d152483-927e-4e59-9206-4f9fff209593 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:58:45.878358 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-9d152483-927e-4e59-9206-4f9fff209593 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1444 microversion: 2.1 time: 0.153512 Aug 12 11:58:45.878944 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 507/1015] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:58:45 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1444 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:58:45.899012 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-41a71de5-926d-44f2-8ccb-9a153825c7a4 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:58:45.899641 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-41a71de5-926d-44f2-8ccb-9a153825c7a4 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:58:45.906060 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-41a71de5-926d-44f2-8ccb-9a153825c7a4 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:45.906532 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-41a71de5-926d-44f2-8ccb-9a153825c7a4 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:45.906993 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-41a71de5-926d-44f2-8ccb-9a153825c7a4 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:45.907676 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-41a71de5-926d-44f2-8ccb-9a153825c7a4 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:45.908118 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-41a71de5-926d-44f2-8ccb-9a153825c7a4 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:45.908529 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-41a71de5-926d-44f2-8ccb-9a153825c7a4 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:46.044733 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-41a71de5-926d-44f2-8ccb-9a153825c7a4 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:58:46.052302 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-41a71de5-926d-44f2-8ccb-9a153825c7a4 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1444 microversion: 2.1 time: 0.157079 Aug 12 11:58:46.052869 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 509/1016] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:58:45 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:58:47.811704 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-1158397a-de01-4fdd-9bca-c7f65c38c8a7 req-723511fe-cee8-4621-ae27-4995f9fef284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9e68aca-3dd9-485f-b14f-fc3b9face4fd", "tag": "eac729c6-2ebe-467e-bcc1-a5afd019c575"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:58:47.822139 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-1158397a-de01-4fdd-9bca-c7f65c38c8a7 req-723511fe-cee8-4621-ae27-4995f9fef284 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:58:47.824929 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-1158397a-de01-4fdd-9bca-c7f65c38c8a7 req-723511fe-cee8-4621-ae27-4995f9fef284 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:58:47.825601 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-1158397a-de01-4fdd-9bca-c7f65c38c8a7 req-723511fe-cee8-4621-ae27-4995f9fef284 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:58:47.843659 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-1158397a-de01-4fdd-9bca-c7f65c38c8a7 req-723511fe-cee8-4621-ae27-4995f9fef284 service nova] Creating event network-changed:eac729c6-2ebe-467e-bcc1-a5afd019c575 for instance f9e68aca-3dd9-485f-b14f-fc3b9face4fd on hv-cinder-85282 Aug 12 11:58:47.850808 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-1158397a-de01-4fdd-9bca-c7f65c38c8a7 req-723511fe-cee8-4621-ae27-4995f9fef284 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043693 Aug 12 11:58:47.851850 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 508/1017] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:59:27.400070 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_api:SELECT=36 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:59:27.400806 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=88 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:59:27.617440 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-0936acf2-eded-4b05-9a49-8fe8d0f176c6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Action: 'create', calling method: .version_select at 0x7f3e5cb033a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1684938935", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIiBbc5HD/4jtCUzZqvGU/Lf3+x2BsvBDRnxYgXWz0f8gSkQJ4o5FCxQU1wXqVhmobYBcApITXqXPtLA4NUEI1XDJl+PmijE6fMCbCy+XXdX4e9f7pUUFsoLSnbHkC4oZg=="}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:59:27.635116 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.quota [None req-0936acf2-eded-4b05-9a49-8fe8d0f176c6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Getting quotas for project 45a982b3e219420fb17c07b591042992. Resources: {'key_pairs'} {{(pid=132281) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:59:27.639625 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.quota [None req-0936acf2-eded-4b05-9a49-8fe8d0f176c6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Getting quotas for user bd3289f4fa7745ceb12f4d5cd7f901c6 and project 45a982b3e219420fb17c07b591042992. Resources: {'key_pairs'} {{(pid=132281) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:59:27.669324 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-0936acf2-eded-4b05-9a49-8fe8d0f176c6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.273747 Aug 12 11:59:27.670326 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 510/1018] 10.222.0.42 () {60 vars in 1159 bytes} [Fri Aug 12 11:59:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:59:45.180642 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:59:45.181375 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=6 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:59:45.185446 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-a55e6584-0bda-4769-be91-29c361eb0628 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-449473554", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1684938935", "security_groups": [{"name": "tempest-secgroup-smoke-1389924360"}], "block_device_mapping_v2": [{"uuid": "26314bad-2bb7-45f8-9d47-aad3a4698592", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d2756a4f-409c-444c-908b-ef5d0ae82e6c"}]}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:59:45.392760 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.network.neutron [None req-a55e6584-0bda-4769-be91-29c361eb0628 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] validate_networks() for [('d2756a4f-409c-444c-908b-ef5d0ae82e6c', None, None, None, None, None)] {{(pid=132282) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 11:59:45.752678 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-a55e6584-0bda-4769-be91-29c361eb0628 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Flavor limits 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 11:59:45.753095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-a55e6584-0bda-4769-be91-29c361eb0628 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Image limits 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 11:59:45.753565 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-a55e6584-0bda-4769-be91-29c361eb0628 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Flavor pref 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 11:59:45.753968 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-a55e6584-0bda-4769-be91-29c361eb0628 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Image pref 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 11:59:45.754375 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-a55e6584-0bda-4769-be91-29c361eb0628 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 11:59:45.763600 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a55e6584-0bda-4769-be91-29c361eb0628 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:59:45.764073 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a55e6584-0bda-4769-be91-29c361eb0628 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:59:45.764501 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a55e6584-0bda-4769-be91-29c361eb0628 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:59:45.765223 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a55e6584-0bda-4769-be91-29c361eb0628 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:59:45.765667 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a55e6584-0bda-4769-be91-29c361eb0628 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:59:45.766085 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a55e6584-0bda-4769-be91-29c361eb0628 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:59:45.782545 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-a55e6584-0bda-4769-be91-29c361eb0628 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Getting quotas for project 45a982b3e219420fb17c07b591042992. Resources: {'instances', 'ram', 'cores'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 11:59:45.786433 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-a55e6584-0bda-4769-be91-29c361eb0628 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Getting quotas for user bd3289f4fa7745ceb12f4d5cd7f901c6 and project 45a982b3e219420fb17c07b591042992. Resources: {'instances', 'ram', 'cores'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 11:59:45.845876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-a55e6584-0bda-4769-be91-29c361eb0628 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Going to run 1 instances... {{(pid=132282) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 11:59:45.848096 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-a55e6584-0bda-4769-be91-29c361eb0628 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 360f8059-fa58-4972-a431-b0822d419e4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='26314bad-2bb7-45f8-9d47-aad3a4698592',volume_size=None,volume_type=None)] {{(pid=132282) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 11:59:45.973775 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-a55e6584-0bda-4769-be91-29c361eb0628 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.794817 Aug 12 11:59:45.974441 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 509/1019] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Aug 12 11:59:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 11:59:45.985251 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-d43c12a0-b44e-4144-b02e-0198a1698ef2 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:59:45.985858 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-d43c12a0-b44e-4144-b02e-0198a1698ef2 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 360f8059-fa58-4972-a431-b0822d419e4e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:59:45.992180 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell0:SELECT=4 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:59:45.992866 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:59:46.146413 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-d43c12a0-b44e-4144-b02e-0198a1698ef2 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:59:46.156541 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-d43c12a0-b44e-4144-b02e-0198a1698ef2 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e" status: 200 len: 1094 microversion: 2.1 time: 0.175175 Aug 12 11:59:46.157668 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 511/1020] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:59:45 2022] GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e => generated 1094 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:59:47.179462 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-a0960e07-00a7-408b-bebb-6656e0a6ea85 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:59:47.180078 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-a0960e07-00a7-408b-bebb-6656e0a6ea85 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 360f8059-fa58-4972-a431-b0822d419e4e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:59:47.187898 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a0960e07-00a7-408b-bebb-6656e0a6ea85 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:59:47.188384 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a0960e07-00a7-408b-bebb-6656e0a6ea85 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:59:47.188855 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a0960e07-00a7-408b-bebb-6656e0a6ea85 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:59:47.189572 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a0960e07-00a7-408b-bebb-6656e0a6ea85 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:59:47.190025 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a0960e07-00a7-408b-bebb-6656e0a6ea85 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:59:47.190442 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a0960e07-00a7-408b-bebb-6656e0a6ea85 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:59:47.263357 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-a0960e07-00a7-408b-bebb-6656e0a6ea85 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:59:47.270728 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-a0960e07-00a7-408b-bebb-6656e0a6ea85 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e" status: 200 len: 1210 microversion: 2.1 time: 0.095117 Aug 12 11:59:47.271299 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 510/1021] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:59:47 2022] GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:59:48.292533 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-1385bbb3-eda7-4c38-9fc8-db25abe1d706 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:59:48.293155 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-1385bbb3-eda7-4c38-9fc8-db25abe1d706 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 360f8059-fa58-4972-a431-b0822d419e4e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:59:48.301323 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1385bbb3-eda7-4c38-9fc8-db25abe1d706 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:59:48.301817 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1385bbb3-eda7-4c38-9fc8-db25abe1d706 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:59:48.302246 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1385bbb3-eda7-4c38-9fc8-db25abe1d706 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:59:48.302975 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1385bbb3-eda7-4c38-9fc8-db25abe1d706 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:59:48.303479 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1385bbb3-eda7-4c38-9fc8-db25abe1d706 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:59:48.303888 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1385bbb3-eda7-4c38-9fc8-db25abe1d706 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:59:48.506855 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-1385bbb3-eda7-4c38-9fc8-db25abe1d706 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:59:48.514373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-1385bbb3-eda7-4c38-9fc8-db25abe1d706 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e" status: 200 len: 1266 microversion: 2.1 time: 0.225657 Aug 12 11:59:48.515033 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 512/1022] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:59:48 2022] GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:59:48.529861 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-ec6f02df-8c8a-4cdf-bb4e-56175324c5d1 req-352c79a8-149c-4a00-87be-af65de64d888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "360f8059-fa58-4972-a431-b0822d419e4e", "tag": "1aacc717-6271-4f4c-bcb6-cd5e9ce523bd"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:59:48.540283 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-ec6f02df-8c8a-4cdf-bb4e-56175324c5d1 req-352c79a8-149c-4a00-87be-af65de64d888 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:59:48.540759 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-ec6f02df-8c8a-4cdf-bb4e-56175324c5d1 req-352c79a8-149c-4a00-87be-af65de64d888 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:59:48.541425 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-ec6f02df-8c8a-4cdf-bb4e-56175324c5d1 req-352c79a8-149c-4a00-87be-af65de64d888 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:59:48.553065 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-ec6f02df-8c8a-4cdf-bb4e-56175324c5d1 req-352c79a8-149c-4a00-87be-af65de64d888 service nova] Creating event network-changed:1aacc717-6271-4f4c-bcb6-cd5e9ce523bd for instance 360f8059-fa58-4972-a431-b0822d419e4e on hv-cinder-85282 Aug 12 11:59:48.557997 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-ec6f02df-8c8a-4cdf-bb4e-56175324c5d1 req-352c79a8-149c-4a00-87be-af65de64d888 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031646 Aug 12 11:59:48.558513 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 511/1023] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:59:49.534915 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-f81c5503-08be-4eb2-9ee6-809d277b64d8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:59:49.535529 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-f81c5503-08be-4eb2-9ee6-809d277b64d8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 360f8059-fa58-4972-a431-b0822d419e4e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:59:49.541816 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f81c5503-08be-4eb2-9ee6-809d277b64d8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:59:49.542295 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f81c5503-08be-4eb2-9ee6-809d277b64d8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:59:49.542768 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f81c5503-08be-4eb2-9ee6-809d277b64d8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:59:49.543458 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f81c5503-08be-4eb2-9ee6-809d277b64d8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:59:49.543910 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f81c5503-08be-4eb2-9ee6-809d277b64d8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:59:49.544328 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-f81c5503-08be-4eb2-9ee6-809d277b64d8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:59:49.811645 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-f81c5503-08be-4eb2-9ee6-809d277b64d8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:59:49.822584 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-f81c5503-08be-4eb2-9ee6-809d277b64d8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e" status: 200 len: 1266 microversion: 2.1 time: 0.291139 Aug 12 11:59:49.824457 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 513/1024] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:59:49 2022] GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e => generated 1266 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:59:50.847909 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-6615d994-443d-4783-b1dc-10e9331b37ef tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:59:50.848605 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-6615d994-443d-4783-b1dc-10e9331b37ef tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 360f8059-fa58-4972-a431-b0822d419e4e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:59:50.856539 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6615d994-443d-4783-b1dc-10e9331b37ef tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:59:50.857388 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6615d994-443d-4783-b1dc-10e9331b37ef tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:59:50.858149 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6615d994-443d-4783-b1dc-10e9331b37ef tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:59:50.859429 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6615d994-443d-4783-b1dc-10e9331b37ef tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:59:50.860220 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6615d994-443d-4783-b1dc-10e9331b37ef tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:59:50.861000 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6615d994-443d-4783-b1dc-10e9331b37ef tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:59:51.010464 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-6615d994-443d-4783-b1dc-10e9331b37ef tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:59:51.018728 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-6615d994-443d-4783-b1dc-10e9331b37ef tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e" status: 200 len: 1266 microversion: 2.1 time: 0.175509 Aug 12 11:59:51.019289 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 512/1025] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:59:50 2022] GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:59:52.039749 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-2ce0b113-68b2-4087-bb25-97ed1411823f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:59:52.040418 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-2ce0b113-68b2-4087-bb25-97ed1411823f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 360f8059-fa58-4972-a431-b0822d419e4e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:59:52.046876 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2ce0b113-68b2-4087-bb25-97ed1411823f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:59:52.047360 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2ce0b113-68b2-4087-bb25-97ed1411823f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:59:52.047796 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2ce0b113-68b2-4087-bb25-97ed1411823f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:59:52.048489 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2ce0b113-68b2-4087-bb25-97ed1411823f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:59:52.048948 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2ce0b113-68b2-4087-bb25-97ed1411823f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:59:52.049370 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2ce0b113-68b2-4087-bb25-97ed1411823f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:59:52.176737 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-2ce0b113-68b2-4087-bb25-97ed1411823f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:59:52.184276 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-2ce0b113-68b2-4087-bb25-97ed1411823f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e" status: 200 len: 1266 microversion: 2.1 time: 0.148406 Aug 12 11:59:52.184842 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 514/1026] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:59:52 2022] GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:59:53.205183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-5e51c2c7-f301-4c3d-868c-e437578d73a8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:59:53.205741 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-5e51c2c7-f301-4c3d-868c-e437578d73a8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 360f8059-fa58-4972-a431-b0822d419e4e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:59:53.212316 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5e51c2c7-f301-4c3d-868c-e437578d73a8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:59:53.212806 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5e51c2c7-f301-4c3d-868c-e437578d73a8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:59:53.213242 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5e51c2c7-f301-4c3d-868c-e437578d73a8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:59:53.213938 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5e51c2c7-f301-4c3d-868c-e437578d73a8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:59:53.214392 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5e51c2c7-f301-4c3d-868c-e437578d73a8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:59:53.214854 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5e51c2c7-f301-4c3d-868c-e437578d73a8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:59:53.350004 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-5e51c2c7-f301-4c3d-868c-e437578d73a8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:59:53.358505 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-5e51c2c7-f301-4c3d-868c-e437578d73a8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e" status: 200 len: 1266 microversion: 2.1 time: 0.157372 Aug 12 11:59:53.359096 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 513/1027] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:59:53 2022] GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:59:54.379861 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e953091f-7b48-4ad0-8fc7-caf6cc73860a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:59:54.380466 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-e953091f-7b48-4ad0-8fc7-caf6cc73860a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 360f8059-fa58-4972-a431-b0822d419e4e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:59:54.386780 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e953091f-7b48-4ad0-8fc7-caf6cc73860a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:59:54.387253 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e953091f-7b48-4ad0-8fc7-caf6cc73860a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:59:54.387699 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e953091f-7b48-4ad0-8fc7-caf6cc73860a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:59:54.388374 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e953091f-7b48-4ad0-8fc7-caf6cc73860a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:59:54.388813 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e953091f-7b48-4ad0-8fc7-caf6cc73860a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:59:54.389233 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e953091f-7b48-4ad0-8fc7-caf6cc73860a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:59:54.517962 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-e953091f-7b48-4ad0-8fc7-caf6cc73860a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:59:54.525326 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-e953091f-7b48-4ad0-8fc7-caf6cc73860a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e" status: 200 len: 1266 microversion: 2.1 time: 0.149307 Aug 12 11:59:54.525900 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 515/1028] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:59:54 2022] GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:59:55.546800 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-b4141007-9102-4d68-9f5f-3fec3c98c633 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:59:55.546800 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-b4141007-9102-4d68-9f5f-3fec3c98c633 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 360f8059-fa58-4972-a431-b0822d419e4e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:59:55.552912 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b4141007-9102-4d68-9f5f-3fec3c98c633 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:59:55.553391 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b4141007-9102-4d68-9f5f-3fec3c98c633 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:59:55.553828 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b4141007-9102-4d68-9f5f-3fec3c98c633 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:59:55.554513 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b4141007-9102-4d68-9f5f-3fec3c98c633 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:59:55.555017 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b4141007-9102-4d68-9f5f-3fec3c98c633 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:59:55.555440 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b4141007-9102-4d68-9f5f-3fec3c98c633 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:59:55.748095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-b4141007-9102-4d68-9f5f-3fec3c98c633 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:59:55.756160 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-b4141007-9102-4d68-9f5f-3fec3c98c633 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e" status: 200 len: 1266 microversion: 2.1 time: 0.214016 Aug 12 11:59:55.756703 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 514/1029] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:59:55 2022] GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:59:56.777448 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-384868aa-bb3e-48dd-aa98-b540f06ad8f1 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:59:56.778094 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-384868aa-bb3e-48dd-aa98-b540f06ad8f1 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 360f8059-fa58-4972-a431-b0822d419e4e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:59:56.780649 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell0:SELECT=2 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:59:56.786518 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-384868aa-bb3e-48dd-aa98-b540f06ad8f1 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:59:56.787032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-384868aa-bb3e-48dd-aa98-b540f06ad8f1 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:59:56.788045 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-384868aa-bb3e-48dd-aa98-b540f06ad8f1 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:59:56.788751 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-384868aa-bb3e-48dd-aa98-b540f06ad8f1 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:59:56.789204 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-384868aa-bb3e-48dd-aa98-b540f06ad8f1 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:59:56.789664 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-384868aa-bb3e-48dd-aa98-b540f06ad8f1 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:59:56.925230 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-384868aa-bb3e-48dd-aa98-b540f06ad8f1 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:59:56.932701 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-384868aa-bb3e-48dd-aa98-b540f06ad8f1 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e" status: 200 len: 1266 microversion: 2.1 time: 0.159817 Aug 12 11:59:56.933260 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 516/1030] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:59:56 2022] GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:59:57.953272 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-dff356d3-6246-43df-9e1d-19bdadac9adf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:59:57.953879 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-dff356d3-6246-43df-9e1d-19bdadac9adf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 360f8059-fa58-4972-a431-b0822d419e4e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:59:57.955898 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=2 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:59:57.956541 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=6 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:59:57.962572 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-dff356d3-6246-43df-9e1d-19bdadac9adf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:59:57.963073 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-dff356d3-6246-43df-9e1d-19bdadac9adf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:59:57.963537 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-dff356d3-6246-43df-9e1d-19bdadac9adf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:59:57.964217 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-dff356d3-6246-43df-9e1d-19bdadac9adf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:59:57.964663 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-dff356d3-6246-43df-9e1d-19bdadac9adf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:59:57.965083 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-dff356d3-6246-43df-9e1d-19bdadac9adf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:59:58.092195 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-dff356d3-6246-43df-9e1d-19bdadac9adf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:59:58.099554 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-dff356d3-6246-43df-9e1d-19bdadac9adf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e" status: 200 len: 1266 microversion: 2.1 time: 0.150109 Aug 12 11:59:58.100102 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 515/1031] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:59:57 2022] GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:59:58.805412 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-f7c2e164-30ef-44f7-ab55-584b167e7c82 req-6f687f06-1d3f-46d1-a9cb-6514935103a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "360f8059-fa58-4972-a431-b0822d419e4e", "name": "network-vif-plugged", "status": "completed", "tag": "1aacc717-6271-4f4c-bcb6-cd5e9ce523bd"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:59:58.810927 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 11:59:58.811184 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Fri Aug 12 11:59:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Aug 12 11:59:58.819587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-f7c2e164-30ef-44f7-ab55-584b167e7c82 req-6f687f06-1d3f-46d1-a9cb-6514935103a4 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:59:58.820308 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-f7c2e164-30ef-44f7-ab55-584b167e7c82 req-6f687f06-1d3f-46d1-a9cb-6514935103a4 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:59:58.820744 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-f7c2e164-30ef-44f7-ab55-584b167e7c82 req-6f687f06-1d3f-46d1-a9cb-6514935103a4 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:59:58.833216 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-f7c2e164-30ef-44f7-ab55-584b167e7c82 req-6f687f06-1d3f-46d1-a9cb-6514935103a4 service nova] Creating event network-vif-plugged:1aacc717-6271-4f4c-bcb6-cd5e9ce523bd for instance 360f8059-fa58-4972-a431-b0822d419e4e on hv-cinder-85282 Aug 12 11:59:58.838427 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-f7c2e164-30ef-44f7-ab55-584b167e7c82 req-6f687f06-1d3f-46d1-a9cb-6514935103a4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036992 Aug 12 11:59:58.838999 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 517/1032] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 11:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:59:59.120246 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-0c965a54-607e-409d-bdf3-662327459850 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:59:59.120855 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-0c965a54-607e-409d-bdf3-662327459850 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 360f8059-fa58-4972-a431-b0822d419e4e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:59:59.127501 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0c965a54-607e-409d-bdf3-662327459850 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:59:59.127643 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0c965a54-607e-409d-bdf3-662327459850 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:59:59.128074 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0c965a54-607e-409d-bdf3-662327459850 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:59:59.128769 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0c965a54-607e-409d-bdf3-662327459850 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:59:59.129218 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0c965a54-607e-409d-bdf3-662327459850 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:59:59.129647 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0c965a54-607e-409d-bdf3-662327459850 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:59:59.271897 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-0c965a54-607e-409d-bdf3-662327459850 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:59:59.279361 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-0c965a54-607e-409d-bdf3-662327459850 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e" status: 200 len: 1266 microversion: 2.1 time: 0.162952 Aug 12 11:59:59.279927 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 516/1033] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 11:59:59 2022] GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:00:00.302067 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-17828c34-8011-4e9d-83be-ca8f332ea603 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:00:00.303738 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-17828c34-8011-4e9d-83be-ca8f332ea603 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 360f8059-fa58-4972-a431-b0822d419e4e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:00:00.312378 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-17828c34-8011-4e9d-83be-ca8f332ea603 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:00:00.312871 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-17828c34-8011-4e9d-83be-ca8f332ea603 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:00:00.313330 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-17828c34-8011-4e9d-83be-ca8f332ea603 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:00:00.314784 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-17828c34-8011-4e9d-83be-ca8f332ea603 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:00:00.315257 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-17828c34-8011-4e9d-83be-ca8f332ea603 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:00:00.315757 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-17828c34-8011-4e9d-83be-ca8f332ea603 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:00:00.449070 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-17828c34-8011-4e9d-83be-ca8f332ea603 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:00:00.456764 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-17828c34-8011-4e9d-83be-ca8f332ea603 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e" status: 200 len: 1454 microversion: 2.1 time: 0.159724 Aug 12 12:00:00.457331 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 518/1034] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:00:00 2022] GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:00:00.477001 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-51bca465-4f63-4fd5-bdcd-3e4ff8523e3c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:00:00.477616 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-51bca465-4f63-4fd5-bdcd-3e4ff8523e3c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 360f8059-fa58-4972-a431-b0822d419e4e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:00:00.484058 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-51bca465-4f63-4fd5-bdcd-3e4ff8523e3c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:00:00.484541 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-51bca465-4f63-4fd5-bdcd-3e4ff8523e3c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:00:00.484976 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-51bca465-4f63-4fd5-bdcd-3e4ff8523e3c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:00:00.486262 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-51bca465-4f63-4fd5-bdcd-3e4ff8523e3c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:00:00.486745 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-51bca465-4f63-4fd5-bdcd-3e4ff8523e3c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:00:00.487172 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-51bca465-4f63-4fd5-bdcd-3e4ff8523e3c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:00:00.617424 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-51bca465-4f63-4fd5-bdcd-3e4ff8523e3c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:00:00.625024 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-51bca465-4f63-4fd5-bdcd-3e4ff8523e3c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e" status: 200 len: 1454 microversion: 2.1 time: 0.151811 Aug 12 12:00:00.625580 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 517/1035] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:00:00 2022] GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:00:02.490139 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-d1153e27-621b-4edc-8d7f-5373310c848e req-a58fc93a-9a57-403b-81a8-9564e6e3fcd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "360f8059-fa58-4972-a431-b0822d419e4e", "tag": "1aacc717-6271-4f4c-bcb6-cd5e9ce523bd"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:00:02.499786 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-d1153e27-621b-4edc-8d7f-5373310c848e req-a58fc93a-9a57-403b-81a8-9564e6e3fcd1 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:00:02.500264 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-d1153e27-621b-4edc-8d7f-5373310c848e req-a58fc93a-9a57-403b-81a8-9564e6e3fcd1 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:00:02.500694 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-d1153e27-621b-4edc-8d7f-5373310c848e req-a58fc93a-9a57-403b-81a8-9564e6e3fcd1 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:00:02.514262 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-d1153e27-621b-4edc-8d7f-5373310c848e req-a58fc93a-9a57-403b-81a8-9564e6e3fcd1 service nova] Creating event network-changed:1aacc717-6271-4f4c-bcb6-cd5e9ce523bd for instance 360f8059-fa58-4972-a431-b0822d419e4e on hv-cinder-85282 Aug 12 12:00:02.519798 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-d1153e27-621b-4edc-8d7f-5373310c848e req-a58fc93a-9a57-403b-81a8-9564e6e3fcd1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033546 Aug 12 12:00:02.520577 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 519/1036] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 12:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:00:52.804501 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-b2541237-ecfc-4a62-ab4d-799471a2c685 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:00:52.805112 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-b2541237-ecfc-4a62-ab4d-799471a2c685 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:00:52.807240 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:00:52.807893 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=46 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:00:52.814475 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b2541237-ecfc-4a62-ab4d-799471a2c685 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:00:52.814984 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b2541237-ecfc-4a62-ab4d-799471a2c685 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:00:52.815425 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b2541237-ecfc-4a62-ab4d-799471a2c685 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:00:52.816119 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b2541237-ecfc-4a62-ab4d-799471a2c685 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:00:52.816835 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b2541237-ecfc-4a62-ab4d-799471a2c685 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:00:52.817263 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b2541237-ecfc-4a62-ab4d-799471a2c685 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:00:52.840083 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.objects.instance [None req-b2541237-ecfc-4a62-ab4d-799471a2c685 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lazy-loading 'flavor' on Instance uuid f9e68aca-3dd9-485f-b14f-fc3b9face4fd {{(pid=132282) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:00:52.912648 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-b2541237-ecfc-4a62-ab4d-799471a2c685 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "POST /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd/action" status: 202 len: 0 microversion: 2.1 time: 0.111812 Aug 12 12:00:52.913222 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 518/1037] 10.222.0.42 () {60 vars in 1278 bytes} [Fri Aug 12 12:00:52 2022] POST /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:00:52.919516 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_api:SELECT=20 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:00:52.920331 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=40 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:00:52.924301 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-4d0f37b5-5c60-4d37-b14b-5cf0b58a0b8b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:00:52.924991 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-4d0f37b5-5c60-4d37-b14b-5cf0b58a0b8b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:00:52.931943 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4d0f37b5-5c60-4d37-b14b-5cf0b58a0b8b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:00:52.932419 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4d0f37b5-5c60-4d37-b14b-5cf0b58a0b8b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:00:52.932868 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4d0f37b5-5c60-4d37-b14b-5cf0b58a0b8b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:00:52.933532 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4d0f37b5-5c60-4d37-b14b-5cf0b58a0b8b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:00:52.933974 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4d0f37b5-5c60-4d37-b14b-5cf0b58a0b8b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:00:52.934474 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4d0f37b5-5c60-4d37-b14b-5cf0b58a0b8b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:00:53.064523 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-4d0f37b5-5c60-4d37-b14b-5cf0b58a0b8b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:00:53.072159 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-4d0f37b5-5c60-4d37-b14b-5cf0b58a0b8b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1569 microversion: 2.1 time: 0.154319 Aug 12 12:00:53.072711 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 520/1038] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:00:52 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:00:54.093364 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-72ed1c7a-f987-4379-985c-a22f45ec348d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:00:54.094634 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-72ed1c7a-f987-4379-985c-a22f45ec348d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:00:54.101245 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-72ed1c7a-f987-4379-985c-a22f45ec348d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:00:54.101720 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-72ed1c7a-f987-4379-985c-a22f45ec348d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:00:54.102153 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-72ed1c7a-f987-4379-985c-a22f45ec348d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:00:54.102859 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-72ed1c7a-f987-4379-985c-a22f45ec348d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:00:54.103304 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-72ed1c7a-f987-4379-985c-a22f45ec348d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:00:54.103721 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-72ed1c7a-f987-4379-985c-a22f45ec348d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:00:54.235565 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-72ed1c7a-f987-4379-985c-a22f45ec348d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:00:54.243464 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-72ed1c7a-f987-4379-985c-a22f45ec348d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1569 microversion: 2.1 time: 0.154300 Aug 12 12:00:54.244066 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 519/1039] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:00:54 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:00:55.264559 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-4a508a55-9a96-4333-979f-d81deca2a040 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:00:55.265138 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-4a508a55-9a96-4333-979f-d81deca2a040 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:00:55.271944 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4a508a55-9a96-4333-979f-d81deca2a040 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:00:55.272423 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4a508a55-9a96-4333-979f-d81deca2a040 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:00:55.272850 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4a508a55-9a96-4333-979f-d81deca2a040 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:00:55.273538 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4a508a55-9a96-4333-979f-d81deca2a040 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:00:55.273987 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4a508a55-9a96-4333-979f-d81deca2a040 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:00:55.274409 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4a508a55-9a96-4333-979f-d81deca2a040 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:00:55.403965 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-4a508a55-9a96-4333-979f-d81deca2a040 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:00:55.412010 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-4a508a55-9a96-4333-979f-d81deca2a040 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1569 microversion: 2.1 time: 0.151388 Aug 12 12:00:55.412564 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 521/1040] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:00:55 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:00:56.432911 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-c7031508-97f3-40ba-b038-485e349e83bf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:00:56.433512 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-c7031508-97f3-40ba-b038-485e349e83bf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:00:56.439329 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c7031508-97f3-40ba-b038-485e349e83bf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:00:56.439805 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c7031508-97f3-40ba-b038-485e349e83bf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:00:56.440238 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c7031508-97f3-40ba-b038-485e349e83bf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:00:56.440913 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c7031508-97f3-40ba-b038-485e349e83bf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:00:56.441618 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c7031508-97f3-40ba-b038-485e349e83bf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:00:56.442035 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c7031508-97f3-40ba-b038-485e349e83bf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:00:56.652811 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-c7031508-97f3-40ba-b038-485e349e83bf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:00:56.660660 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-c7031508-97f3-40ba-b038-485e349e83bf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1569 microversion: 2.1 time: 0.231812 Aug 12 12:00:56.661215 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 520/1041] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:00:56 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1569 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:00:57.681177 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-346fd6e7-2d12-45d3-a507-493e297c7b91 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:00:57.681843 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-346fd6e7-2d12-45d3-a507-493e297c7b91 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:00:57.688247 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-346fd6e7-2d12-45d3-a507-493e297c7b91 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:00:57.688721 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-346fd6e7-2d12-45d3-a507-493e297c7b91 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:00:57.689150 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-346fd6e7-2d12-45d3-a507-493e297c7b91 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:00:57.689831 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-346fd6e7-2d12-45d3-a507-493e297c7b91 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:00:57.690275 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-346fd6e7-2d12-45d3-a507-493e297c7b91 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:00:57.690716 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-346fd6e7-2d12-45d3-a507-493e297c7b91 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:00:57.831358 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-346fd6e7-2d12-45d3-a507-493e297c7b91 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:00:57.838803 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-346fd6e7-2d12-45d3-a507-493e297c7b91 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1569 microversion: 2.1 time: 0.161470 Aug 12 12:00:57.839390 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 522/1042] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:00:57 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:00:58.860030 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-5bd150b3-d1bc-4ac9-8ea4-787999c83205 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:00:58.860694 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-5bd150b3-d1bc-4ac9-8ea4-787999c83205 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:00:58.867044 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5bd150b3-d1bc-4ac9-8ea4-787999c83205 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:00:58.867516 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5bd150b3-d1bc-4ac9-8ea4-787999c83205 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:00:58.867945 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5bd150b3-d1bc-4ac9-8ea4-787999c83205 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:00:58.868621 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5bd150b3-d1bc-4ac9-8ea4-787999c83205 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:00:58.869067 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5bd150b3-d1bc-4ac9-8ea4-787999c83205 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:00:58.869488 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5bd150b3-d1bc-4ac9-8ea4-787999c83205 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:00:58.998453 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-5bd150b3-d1bc-4ac9-8ea4-787999c83205 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:00:59.006427 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-5bd150b3-d1bc-4ac9-8ea4-787999c83205 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1569 microversion: 2.1 time: 0.150309 Aug 12 12:00:59.007001 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 521/1043] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:00:58 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:01:00.026485 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-353337b2-3e6b-4e03-b6a5-d6ef0d2ea9ef tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:01:00.027142 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-353337b2-3e6b-4e03-b6a5-d6ef0d2ea9ef tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:01:00.034739 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-353337b2-3e6b-4e03-b6a5-d6ef0d2ea9ef tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:00.035219 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-353337b2-3e6b-4e03-b6a5-d6ef0d2ea9ef tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:00.035850 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-353337b2-3e6b-4e03-b6a5-d6ef0d2ea9ef tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:00.036536 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-353337b2-3e6b-4e03-b6a5-d6ef0d2ea9ef tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:00.036982 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-353337b2-3e6b-4e03-b6a5-d6ef0d2ea9ef tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:00.037404 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-353337b2-3e6b-4e03-b6a5-d6ef0d2ea9ef tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:00.173630 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-353337b2-3e6b-4e03-b6a5-d6ef0d2ea9ef tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:01:00.181702 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-353337b2-3e6b-4e03-b6a5-d6ef0d2ea9ef tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1569 microversion: 2.1 time: 0.159006 Aug 12 12:01:00.182324 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 523/1044] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:01:00 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:01:01.203263 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-8490a34f-c00a-4025-9757-ca8bbc25ab9b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:01:01.203792 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-8490a34f-c00a-4025-9757-ca8bbc25ab9b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:01:01.210632 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8490a34f-c00a-4025-9757-ca8bbc25ab9b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:01.211126 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8490a34f-c00a-4025-9757-ca8bbc25ab9b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:01.211576 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8490a34f-c00a-4025-9757-ca8bbc25ab9b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:01.212239 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8490a34f-c00a-4025-9757-ca8bbc25ab9b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:01.212687 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8490a34f-c00a-4025-9757-ca8bbc25ab9b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:01.213106 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8490a34f-c00a-4025-9757-ca8bbc25ab9b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:01.339321 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-8490a34f-c00a-4025-9757-ca8bbc25ab9b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:01:01.347565 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-8490a34f-c00a-4025-9757-ca8bbc25ab9b tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1569 microversion: 2.1 time: 0.148225 Aug 12 12:01:01.348150 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 522/1045] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:01:01 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:01:02.367664 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e304459a-c116-4dca-8658-efad42a957a1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:01:02.368274 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-e304459a-c116-4dca-8658-efad42a957a1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:01:02.374827 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e304459a-c116-4dca-8658-efad42a957a1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:02.375309 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e304459a-c116-4dca-8658-efad42a957a1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:02.375740 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e304459a-c116-4dca-8658-efad42a957a1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:02.376482 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e304459a-c116-4dca-8658-efad42a957a1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:02.376936 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e304459a-c116-4dca-8658-efad42a957a1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:02.377360 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e304459a-c116-4dca-8658-efad42a957a1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:02.513796 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-e304459a-c116-4dca-8658-efad42a957a1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:01:02.521525 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-e304459a-c116-4dca-8658-efad42a957a1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1569 microversion: 2.1 time: 0.157649 Aug 12 12:01:02.522093 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 524/1046] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:01:02 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:01:03.542777 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d10ef4c2-a135-4f47-a96f-ba8b6875a245 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:01:03.543411 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d10ef4c2-a135-4f47-a96f-ba8b6875a245 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:01:03.550350 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d10ef4c2-a135-4f47-a96f-ba8b6875a245 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:03.550865 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d10ef4c2-a135-4f47-a96f-ba8b6875a245 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:03.551306 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d10ef4c2-a135-4f47-a96f-ba8b6875a245 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:03.551996 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d10ef4c2-a135-4f47-a96f-ba8b6875a245 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:03.552480 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d10ef4c2-a135-4f47-a96f-ba8b6875a245 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:03.552902 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d10ef4c2-a135-4f47-a96f-ba8b6875a245 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:03.749538 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d10ef4c2-a135-4f47-a96f-ba8b6875a245 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:01:03.757656 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-d10ef4c2-a135-4f47-a96f-ba8b6875a245 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1569 microversion: 2.1 time: 0.218854 Aug 12 12:01:03.758255 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 523/1047] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:01:03 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:01:04.778384 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-97c2c01b-2e06-482f-a35c-8e4a88b72cc0 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:01:04.779030 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-97c2c01b-2e06-482f-a35c-8e4a88b72cc0 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:01:04.785496 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-97c2c01b-2e06-482f-a35c-8e4a88b72cc0 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:04.785969 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-97c2c01b-2e06-482f-a35c-8e4a88b72cc0 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:04.786398 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-97c2c01b-2e06-482f-a35c-8e4a88b72cc0 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:04.787105 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-97c2c01b-2e06-482f-a35c-8e4a88b72cc0 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:04.787553 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-97c2c01b-2e06-482f-a35c-8e4a88b72cc0 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:04.787969 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-97c2c01b-2e06-482f-a35c-8e4a88b72cc0 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:04.921486 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-97c2c01b-2e06-482f-a35c-8e4a88b72cc0 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:01:04.929563 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-97c2c01b-2e06-482f-a35c-8e4a88b72cc0 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1569 microversion: 2.1 time: 0.155182 Aug 12 12:01:04.930126 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 525/1048] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:01:04 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:01:05.952536 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-c2e903bb-39ab-44d4-877c-4f7a2313a531 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:01:05.953150 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-c2e903bb-39ab-44d4-877c-4f7a2313a531 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:01:05.959990 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c2e903bb-39ab-44d4-877c-4f7a2313a531 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:05.960540 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c2e903bb-39ab-44d4-877c-4f7a2313a531 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:05.960904 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c2e903bb-39ab-44d4-877c-4f7a2313a531 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:05.961587 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c2e903bb-39ab-44d4-877c-4f7a2313a531 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:05.962038 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c2e903bb-39ab-44d4-877c-4f7a2313a531 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:05.962460 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c2e903bb-39ab-44d4-877c-4f7a2313a531 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:06.094422 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-c2e903bb-39ab-44d4-877c-4f7a2313a531 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:01:06.101876 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-c2e903bb-39ab-44d4-877c-4f7a2313a531 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1569 microversion: 2.1 time: 0.153212 Aug 12 12:01:06.102441 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 524/1049] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:01:05 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:01:07.122440 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-a042d8d9-65ee-46ea-8f28-5ca3903c7a78 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:01:07.123065 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-a042d8d9-65ee-46ea-8f28-5ca3903c7a78 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:01:07.129613 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a042d8d9-65ee-46ea-8f28-5ca3903c7a78 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:07.130044 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a042d8d9-65ee-46ea-8f28-5ca3903c7a78 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:07.130483 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a042d8d9-65ee-46ea-8f28-5ca3903c7a78 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:07.131220 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a042d8d9-65ee-46ea-8f28-5ca3903c7a78 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:07.131664 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a042d8d9-65ee-46ea-8f28-5ca3903c7a78 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:07.132094 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a042d8d9-65ee-46ea-8f28-5ca3903c7a78 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:07.261050 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-a042d8d9-65ee-46ea-8f28-5ca3903c7a78 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:01:07.268888 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-a042d8d9-65ee-46ea-8f28-5ca3903c7a78 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1510 microversion: 2.1 time: 0.150439 Aug 12 12:01:07.269443 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 526/1050] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:01:07 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:01:07.288895 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-ea1ff54a-f445-46be-9818-5721f5e1a3e5 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:01:07.289486 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-ea1ff54a-f445-46be-9818-5721f5e1a3e5 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:01:07.295766 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ea1ff54a-f445-46be-9818-5721f5e1a3e5 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:07.296238 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ea1ff54a-f445-46be-9818-5721f5e1a3e5 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:07.296668 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ea1ff54a-f445-46be-9818-5721f5e1a3e5 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:07.297339 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ea1ff54a-f445-46be-9818-5721f5e1a3e5 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:07.297782 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ea1ff54a-f445-46be-9818-5721f5e1a3e5 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:07.298198 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ea1ff54a-f445-46be-9818-5721f5e1a3e5 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:07.326238 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-ea1ff54a-f445-46be-9818-5721f5e1a3e5 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132282) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 12 12:01:07.394948 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-ea1ff54a-f445-46be-9818-5721f5e1a3e5 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "POST /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd/action" status: 202 len: 0 microversion: 2.1 time: 0.109628 Aug 12 12:01:07.395846 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 525/1051] 10.222.0.42 () {60 vars in 1278 bytes} [Fri Aug 12 12:01:07 2022] POST /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:01:07.403853 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-25374f0d-2d6d-4b33-8722-631010212732 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:01:07.404459 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-25374f0d-2d6d-4b33-8722-631010212732 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:01:07.411038 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-25374f0d-2d6d-4b33-8722-631010212732 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:07.411519 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-25374f0d-2d6d-4b33-8722-631010212732 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:07.411959 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-25374f0d-2d6d-4b33-8722-631010212732 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:07.412646 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-25374f0d-2d6d-4b33-8722-631010212732 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:07.413093 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-25374f0d-2d6d-4b33-8722-631010212732 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:07.413515 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-25374f0d-2d6d-4b33-8722-631010212732 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:07.576083 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-25374f0d-2d6d-4b33-8722-631010212732 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:01:07.584253 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-25374f0d-2d6d-4b33-8722-631010212732 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1518 microversion: 2.1 time: 0.184251 Aug 12 12:01:07.584813 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 527/1052] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:01:07 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1518 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:01:08.604678 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-0420f11a-e211-4b1e-8f14-46dcba796f70 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:01:08.605285 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-0420f11a-e211-4b1e-8f14-46dcba796f70 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:01:08.611629 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0420f11a-e211-4b1e-8f14-46dcba796f70 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:08.612095 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0420f11a-e211-4b1e-8f14-46dcba796f70 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:08.612528 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0420f11a-e211-4b1e-8f14-46dcba796f70 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:08.613210 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0420f11a-e211-4b1e-8f14-46dcba796f70 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:08.613658 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0420f11a-e211-4b1e-8f14-46dcba796f70 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:08.614078 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-0420f11a-e211-4b1e-8f14-46dcba796f70 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:08.747103 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-0420f11a-e211-4b1e-8f14-46dcba796f70 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:01:08.755714 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-0420f11a-e211-4b1e-8f14-46dcba796f70 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1518 microversion: 2.1 time: 0.154836 Aug 12 12:01:08.756277 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 526/1053] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:01:08 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:01:09.219983 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-3919d1e0-24ab-4963-af44-1ad5d35dbee6 req-fe0393b3-7823-421e-b64a-a9b763835ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9e68aca-3dd9-485f-b14f-fc3b9face4fd", "name": "network-vif-unplugged", "status": "completed", "tag": "eac729c6-2ebe-467e-bcc1-a5afd019c575"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:01:09.229516 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-3919d1e0-24ab-4963-af44-1ad5d35dbee6 req-fe0393b3-7823-421e-b64a-a9b763835ee0 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:09.229939 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-3919d1e0-24ab-4963-af44-1ad5d35dbee6 req-fe0393b3-7823-421e-b64a-a9b763835ee0 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:09.230361 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-3919d1e0-24ab-4963-af44-1ad5d35dbee6 req-fe0393b3-7823-421e-b64a-a9b763835ee0 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:09.242326 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.compute.server_external_events [req-3919d1e0-24ab-4963-af44-1ad5d35dbee6 req-fe0393b3-7823-421e-b64a-a9b763835ee0 service nova] Unable to find a host for instance f9e68aca-3dd9-485f-b14f-fc3b9face4fd. Dropping event network-vif-unplugged {{(pid=132281) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 12 12:01:09.243233 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-3919d1e0-24ab-4963-af44-1ad5d35dbee6 req-fe0393b3-7823-421e-b64a-a9b763835ee0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.082654 Aug 12 12:01:09.243813 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 528/1054] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 12:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 84 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 12 12:01:09.776485 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-568b9e6d-6e49-4624-a990-fe3e6bf9e600 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:01:09.777009 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-568b9e6d-6e49-4624-a990-fe3e6bf9e600 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:01:09.783378 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-568b9e6d-6e49-4624-a990-fe3e6bf9e600 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:09.783888 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-568b9e6d-6e49-4624-a990-fe3e6bf9e600 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:09.784330 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-568b9e6d-6e49-4624-a990-fe3e6bf9e600 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:09.785012 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-568b9e6d-6e49-4624-a990-fe3e6bf9e600 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:09.785467 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-568b9e6d-6e49-4624-a990-fe3e6bf9e600 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:09.785885 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-568b9e6d-6e49-4624-a990-fe3e6bf9e600 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:09.919171 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-568b9e6d-6e49-4624-a990-fe3e6bf9e600 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:01:09.927354 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-568b9e6d-6e49-4624-a990-fe3e6bf9e600 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1518 microversion: 2.1 time: 0.154846 Aug 12 12:01:09.930652 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 527/1055] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:01:09 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:01:10.948611 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-77d29b93-d67e-449d-af31-d316cf6e6532 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:01:10.949241 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-77d29b93-d67e-449d-af31-d316cf6e6532 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:01:10.956119 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-77d29b93-d67e-449d-af31-d316cf6e6532 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:10.956600 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-77d29b93-d67e-449d-af31-d316cf6e6532 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:10.957033 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-77d29b93-d67e-449d-af31-d316cf6e6532 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:10.957766 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-77d29b93-d67e-449d-af31-d316cf6e6532 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:10.958258 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-77d29b93-d67e-449d-af31-d316cf6e6532 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:10.958707 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-77d29b93-d67e-449d-af31-d316cf6e6532 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:11.089709 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-77d29b93-d67e-449d-af31-d316cf6e6532 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:01:11.097501 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-77d29b93-d67e-449d-af31-d316cf6e6532 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1520 microversion: 2.1 time: 0.152656 Aug 12 12:01:11.098071 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 529/1056] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:01:10 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:01:12.118710 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-7a9fb15c-eeb3-46cc-b9a3-4ae4ddcecf28 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:01:12.119358 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-7a9fb15c-eeb3-46cc-b9a3-4ae4ddcecf28 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:01:12.126488 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7a9fb15c-eeb3-46cc-b9a3-4ae4ddcecf28 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:12.127014 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7a9fb15c-eeb3-46cc-b9a3-4ae4ddcecf28 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:12.127454 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7a9fb15c-eeb3-46cc-b9a3-4ae4ddcecf28 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:12.128151 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7a9fb15c-eeb3-46cc-b9a3-4ae4ddcecf28 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:12.128609 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7a9fb15c-eeb3-46cc-b9a3-4ae4ddcecf28 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:12.129037 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-7a9fb15c-eeb3-46cc-b9a3-4ae4ddcecf28 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:12.260806 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-7a9fb15c-eeb3-46cc-b9a3-4ae4ddcecf28 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:01:12.268722 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-7a9fb15c-eeb3-46cc-b9a3-4ae4ddcecf28 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1576 microversion: 2.1 time: 0.153907 Aug 12 12:01:12.269222 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 528/1057] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:01:12 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:01:13.289345 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-1b9baffa-6ba9-42a0-91e6-07cc20fc9e05 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:01:13.289872 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-1b9baffa-6ba9-42a0-91e6-07cc20fc9e05 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:01:13.296188 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1b9baffa-6ba9-42a0-91e6-07cc20fc9e05 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:13.296700 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1b9baffa-6ba9-42a0-91e6-07cc20fc9e05 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:13.297136 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1b9baffa-6ba9-42a0-91e6-07cc20fc9e05 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:13.297830 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1b9baffa-6ba9-42a0-91e6-07cc20fc9e05 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:13.298288 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1b9baffa-6ba9-42a0-91e6-07cc20fc9e05 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:13.298740 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1b9baffa-6ba9-42a0-91e6-07cc20fc9e05 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:13.432861 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-1b9baffa-6ba9-42a0-91e6-07cc20fc9e05 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:01:13.440373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-1b9baffa-6ba9-42a0-91e6-07cc20fc9e05 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1576 microversion: 2.1 time: 0.154987 Aug 12 12:01:13.440938 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 530/1058] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:01:13 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:01:14.515630 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-bc64cffe-77f2-4527-8de8-3e0e289e1681 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:01:14.516280 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-bc64cffe-77f2-4527-8de8-3e0e289e1681 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:01:14.522854 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bc64cffe-77f2-4527-8de8-3e0e289e1681 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:14.523329 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bc64cffe-77f2-4527-8de8-3e0e289e1681 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:14.523843 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bc64cffe-77f2-4527-8de8-3e0e289e1681 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:14.524524 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bc64cffe-77f2-4527-8de8-3e0e289e1681 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:14.524971 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bc64cffe-77f2-4527-8de8-3e0e289e1681 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:14.525390 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-bc64cffe-77f2-4527-8de8-3e0e289e1681 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:14.654412 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-bc64cffe-77f2-4527-8de8-3e0e289e1681 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:01:14.661973 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-bc64cffe-77f2-4527-8de8-3e0e289e1681 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1576 microversion: 2.1 time: 0.150264 Aug 12 12:01:14.662525 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 529/1059] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:01:14 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:01:15.682337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-d82e3c4c-355c-4921-952f-03bf83bb9564 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:01:15.682964 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-d82e3c4c-355c-4921-952f-03bf83bb9564 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:01:15.690245 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d82e3c4c-355c-4921-952f-03bf83bb9564 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:15.690751 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d82e3c4c-355c-4921-952f-03bf83bb9564 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:15.691436 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d82e3c4c-355c-4921-952f-03bf83bb9564 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:15.692117 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d82e3c4c-355c-4921-952f-03bf83bb9564 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:15.692563 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d82e3c4c-355c-4921-952f-03bf83bb9564 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:15.692977 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d82e3c4c-355c-4921-952f-03bf83bb9564 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:15.822376 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-d82e3c4c-355c-4921-952f-03bf83bb9564 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:01:15.830332 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-d82e3c4c-355c-4921-952f-03bf83bb9564 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1576 microversion: 2.1 time: 0.151814 Aug 12 12:01:15.830917 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 531/1060] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:01:15 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:01:16.851121 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-496ed232-e72e-4e56-bd7f-5841ec4d9550 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:01:16.851911 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-496ed232-e72e-4e56-bd7f-5841ec4d9550 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:01:16.858250 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-496ed232-e72e-4e56-bd7f-5841ec4d9550 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:16.858757 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-496ed232-e72e-4e56-bd7f-5841ec4d9550 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:16.859191 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-496ed232-e72e-4e56-bd7f-5841ec4d9550 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:16.859912 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-496ed232-e72e-4e56-bd7f-5841ec4d9550 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:16.860364 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-496ed232-e72e-4e56-bd7f-5841ec4d9550 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:16.860783 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-496ed232-e72e-4e56-bd7f-5841ec4d9550 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:16.991151 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-496ed232-e72e-4e56-bd7f-5841ec4d9550 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:01:16.998511 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-496ed232-e72e-4e56-bd7f-5841ec4d9550 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1576 microversion: 2.1 time: 0.151235 Aug 12 12:01:16.999101 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 530/1061] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:01:16 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:01:18.019692 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-7808087e-404b-4ff7-a4ba-9cdc8a41e88d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:01:18.020335 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-7808087e-404b-4ff7-a4ba-9cdc8a41e88d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:01:18.026663 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7808087e-404b-4ff7-a4ba-9cdc8a41e88d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:18.027141 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7808087e-404b-4ff7-a4ba-9cdc8a41e88d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:18.027571 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7808087e-404b-4ff7-a4ba-9cdc8a41e88d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:18.028250 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7808087e-404b-4ff7-a4ba-9cdc8a41e88d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:18.028692 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7808087e-404b-4ff7-a4ba-9cdc8a41e88d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:18.029103 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-7808087e-404b-4ff7-a4ba-9cdc8a41e88d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:18.159094 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-7808087e-404b-4ff7-a4ba-9cdc8a41e88d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:01:18.166948 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-7808087e-404b-4ff7-a4ba-9cdc8a41e88d tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1576 microversion: 2.1 time: 0.151032 Aug 12 12:01:18.167520 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 532/1062] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:01:18 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:01:19.187640 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-6cf3101e-ee74-4891-9c5e-50e6fcedd446 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:01:19.188249 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-6cf3101e-ee74-4891-9c5e-50e6fcedd446 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:01:19.194925 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6cf3101e-ee74-4891-9c5e-50e6fcedd446 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:19.195408 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6cf3101e-ee74-4891-9c5e-50e6fcedd446 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:19.195843 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6cf3101e-ee74-4891-9c5e-50e6fcedd446 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:19.196533 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6cf3101e-ee74-4891-9c5e-50e6fcedd446 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:19.196992 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6cf3101e-ee74-4891-9c5e-50e6fcedd446 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:19.197414 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-6cf3101e-ee74-4891-9c5e-50e6fcedd446 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:19.216183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:01:19.330412 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-6cf3101e-ee74-4891-9c5e-50e6fcedd446 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:01:19.337928 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-6cf3101e-ee74-4891-9c5e-50e6fcedd446 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1576 microversion: 2.1 time: 0.154097 Aug 12 12:01:19.338496 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 531/1063] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:01:19 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:01:20.358765 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-c2d456c2-4471-46c4-be6f-868758f2e6cf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:01:20.359367 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-c2d456c2-4471-46c4-be6f-868758f2e6cf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:01:20.366299 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c2d456c2-4471-46c4-be6f-868758f2e6cf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:20.366813 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c2d456c2-4471-46c4-be6f-868758f2e6cf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:20.367246 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c2d456c2-4471-46c4-be6f-868758f2e6cf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:20.367926 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c2d456c2-4471-46c4-be6f-868758f2e6cf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:20.368369 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c2d456c2-4471-46c4-be6f-868758f2e6cf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:20.368785 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-c2d456c2-4471-46c4-be6f-868758f2e6cf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:20.500084 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-c2d456c2-4471-46c4-be6f-868758f2e6cf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:01:20.507782 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-c2d456c2-4471-46c4-be6f-868758f2e6cf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1576 microversion: 2.1 time: 0.152967 Aug 12 12:01:20.508340 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 533/1064] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:01:20 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:01:21.301214 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-a0111fc3-4bbf-4b40-9ccf-8d7207069a20 req-f0de5b0b-25d1-4743-9629-8680e7575d54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9e68aca-3dd9-485f-b14f-fc3b9face4fd", "name": "network-vif-plugged", "status": "completed", "tag": "eac729c6-2ebe-467e-bcc1-a5afd019c575"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:01:21.311131 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-a0111fc3-4bbf-4b40-9ccf-8d7207069a20 req-f0de5b0b-25d1-4743-9629-8680e7575d54 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:21.311618 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-a0111fc3-4bbf-4b40-9ccf-8d7207069a20 req-f0de5b0b-25d1-4743-9629-8680e7575d54 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:21.312097 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-a0111fc3-4bbf-4b40-9ccf-8d7207069a20 req-f0de5b0b-25d1-4743-9629-8680e7575d54 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:21.326883 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-a0111fc3-4bbf-4b40-9ccf-8d7207069a20 req-f0de5b0b-25d1-4743-9629-8680e7575d54 service nova] Creating event network-vif-plugged:eac729c6-2ebe-467e-bcc1-a5afd019c575 for instance f9e68aca-3dd9-485f-b14f-fc3b9face4fd on hv-cinder-85282 Aug 12 12:01:21.332431 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-a0111fc3-4bbf-4b40-9ccf-8d7207069a20 req-f0de5b0b-25d1-4743-9629-8680e7575d54 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035292 Aug 12 12:01:21.333015 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 532/1065] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 12:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:01:21.528886 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-829d40a5-f7a4-4bc2-a8d4-26f6be50b3a1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:01:21.529540 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-829d40a5-f7a4-4bc2-a8d4-26f6be50b3a1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:01:21.536528 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-829d40a5-f7a4-4bc2-a8d4-26f6be50b3a1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:21.537000 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-829d40a5-f7a4-4bc2-a8d4-26f6be50b3a1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:21.537438 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-829d40a5-f7a4-4bc2-a8d4-26f6be50b3a1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:21.538099 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-829d40a5-f7a4-4bc2-a8d4-26f6be50b3a1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:21.538541 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-829d40a5-f7a4-4bc2-a8d4-26f6be50b3a1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:21.538977 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-829d40a5-f7a4-4bc2-a8d4-26f6be50b3a1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:21.731165 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-829d40a5-f7a4-4bc2-a8d4-26f6be50b3a1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:01:21.739187 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-829d40a5-f7a4-4bc2-a8d4-26f6be50b3a1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1576 microversion: 2.1 time: 0.214749 Aug 12 12:01:21.739749 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 534/1066] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:01:21 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1576 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:01:22.760509 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-fb225717-6719-4b37-893d-aa53719f3bf8 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:01:22.761233 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-fb225717-6719-4b37-893d-aa53719f3bf8 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:01:22.767742 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fb225717-6719-4b37-893d-aa53719f3bf8 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:22.768221 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fb225717-6719-4b37-893d-aa53719f3bf8 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:22.768651 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fb225717-6719-4b37-893d-aa53719f3bf8 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:22.769338 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fb225717-6719-4b37-893d-aa53719f3bf8 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:22.769785 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fb225717-6719-4b37-893d-aa53719f3bf8 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:22.770201 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-fb225717-6719-4b37-893d-aa53719f3bf8 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:22.900805 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-fb225717-6719-4b37-893d-aa53719f3bf8 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:01:22.908258 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-fb225717-6719-4b37-893d-aa53719f3bf8 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1576 microversion: 2.1 time: 0.151923 Aug 12 12:01:22.908820 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 533/1067] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:01:22 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:01:23.928792 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-1c99025a-4a2d-42ef-8363-39c46fb66a35 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:01:23.929390 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-1c99025a-4a2d-42ef-8363-39c46fb66a35 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:01:23.931681 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_api:SELECT=31 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:01:23.937512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1c99025a-4a2d-42ef-8363-39c46fb66a35 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:23.938525 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1c99025a-4a2d-42ef-8363-39c46fb66a35 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:23.938998 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1c99025a-4a2d-42ef-8363-39c46fb66a35 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:23.939653 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1c99025a-4a2d-42ef-8363-39c46fb66a35 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:23.940096 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1c99025a-4a2d-42ef-8363-39c46fb66a35 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:23.940515 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-1c99025a-4a2d-42ef-8363-39c46fb66a35 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:23.944626 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=87 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:01:24.071798 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-1c99025a-4a2d-42ef-8363-39c46fb66a35 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:01:24.079802 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-1c99025a-4a2d-42ef-8363-39c46fb66a35 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1563 microversion: 2.1 time: 0.154866 Aug 12 12:01:24.080359 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 535/1068] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:01:23 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:01:28.081005 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 12:01:28.081540 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Fri Aug 12 12:01:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 12:01:59.751275 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-4ea56bfe-0854-4305-b8e8-213286d9ff24 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:01:59.751979 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-4ea56bfe-0854-4305-b8e8-213286d9ff24 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 360f8059-fa58-4972-a431-b0822d419e4e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:01:59.753863 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:01:59.754703 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=10 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:01:59.761268 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4ea56bfe-0854-4305-b8e8-213286d9ff24 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:59.761749 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4ea56bfe-0854-4305-b8e8-213286d9ff24 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:59.762188 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4ea56bfe-0854-4305-b8e8-213286d9ff24 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:59.762902 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4ea56bfe-0854-4305-b8e8-213286d9ff24 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:59.763359 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4ea56bfe-0854-4305-b8e8-213286d9ff24 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:59.763785 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4ea56bfe-0854-4305-b8e8-213286d9ff24 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:59.789201 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-4ea56bfe-0854-4305-b8e8-213286d9ff24 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 360f8059-fa58-4972-a431-b0822d419e4e] Going to try to terminate instance {{(pid=132282) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 12:01:59.864900 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-4ea56bfe-0854-4305-b8e8-213286d9ff24 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "DELETE /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e" status: 204 len: 0 microversion: 2.1 time: 0.117866 Aug 12 12:01:59.865478 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 534/1069] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Aug 12 12:01:59 2022] DELETE /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 12:01:59.873587 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-5dbf3811-fd71-4795-9ace-de8e444b3112 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:01:59.874228 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-5dbf3811-fd71-4795-9ace-de8e444b3112 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 360f8059-fa58-4972-a431-b0822d419e4e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:01:59.876719 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_api:SELECT=1 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:01:59.877353 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=5 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:01:59.883262 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5dbf3811-fd71-4795-9ace-de8e444b3112 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:59.883737 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5dbf3811-fd71-4795-9ace-de8e444b3112 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:59.884173 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5dbf3811-fd71-4795-9ace-de8e444b3112 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:01:59.884854 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5dbf3811-fd71-4795-9ace-de8e444b3112 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:01:59.885302 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5dbf3811-fd71-4795-9ace-de8e444b3112 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:01:59.885717 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-5dbf3811-fd71-4795-9ace-de8e444b3112 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:00.016174 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-5dbf3811-fd71-4795-9ace-de8e444b3112 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:02:00.023613 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-5dbf3811-fd71-4795-9ace-de8e444b3112 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e" status: 200 len: 1579 microversion: 2.1 time: 0.153993 Aug 12 12:02:00.024169 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 536/1070] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:01:59 2022] GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:02:01.045120 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-96fbea2d-27f0-4138-83ae-6669bed65bc3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:02:01.045813 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-96fbea2d-27f0-4138-83ae-6669bed65bc3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 360f8059-fa58-4972-a431-b0822d419e4e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:02:01.052258 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-96fbea2d-27f0-4138-83ae-6669bed65bc3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:01.052732 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-96fbea2d-27f0-4138-83ae-6669bed65bc3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:01.053165 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-96fbea2d-27f0-4138-83ae-6669bed65bc3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:01.053846 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-96fbea2d-27f0-4138-83ae-6669bed65bc3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:01.054293 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-96fbea2d-27f0-4138-83ae-6669bed65bc3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:01.054737 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-96fbea2d-27f0-4138-83ae-6669bed65bc3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:01.185577 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-96fbea2d-27f0-4138-83ae-6669bed65bc3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:02:01.193267 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-96fbea2d-27f0-4138-83ae-6669bed65bc3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e" status: 200 len: 1579 microversion: 2.1 time: 0.152395 Aug 12 12:02:01.193828 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 535/1071] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:02:01 2022] GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e => generated 1579 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:02:02.214302 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-4e0e7cc5-445f-4226-9767-c38d02b50e54 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:02:02.214931 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-4e0e7cc5-445f-4226-9767-c38d02b50e54 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 360f8059-fa58-4972-a431-b0822d419e4e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:02:02.221598 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4e0e7cc5-445f-4226-9767-c38d02b50e54 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:02.222074 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4e0e7cc5-445f-4226-9767-c38d02b50e54 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:02.222500 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4e0e7cc5-445f-4226-9767-c38d02b50e54 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:02.223227 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4e0e7cc5-445f-4226-9767-c38d02b50e54 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:02.223673 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4e0e7cc5-445f-4226-9767-c38d02b50e54 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:02.224093 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4e0e7cc5-445f-4226-9767-c38d02b50e54 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:02.457674 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-4e0e7cc5-445f-4226-9767-c38d02b50e54 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:02:02.465122 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-4e0e7cc5-445f-4226-9767-c38d02b50e54 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e" status: 200 len: 1579 microversion: 2.1 time: 0.254686 Aug 12 12:02:02.465912 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 537/1072] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:02:02 2022] GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e => generated 1579 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:02:02.924353 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-a93021b8-4d27-4701-ad42-1d03b9edf5e4 req-aa15b8ac-0d06-40a6-8cd6-7743fb43547e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "360f8059-fa58-4972-a431-b0822d419e4e", "name": "network-vif-deleted", "tag": "1aacc717-6271-4f4c-bcb6-cd5e9ce523bd"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:02:02.933823 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-a93021b8-4d27-4701-ad42-1d03b9edf5e4 req-aa15b8ac-0d06-40a6-8cd6-7743fb43547e service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:02.934596 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-a93021b8-4d27-4701-ad42-1d03b9edf5e4 req-aa15b8ac-0d06-40a6-8cd6-7743fb43547e service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:02.935262 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-a93021b8-4d27-4701-ad42-1d03b9edf5e4 req-aa15b8ac-0d06-40a6-8cd6-7743fb43547e service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:02.961590 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-a93021b8-4d27-4701-ad42-1d03b9edf5e4 req-aa15b8ac-0d06-40a6-8cd6-7743fb43547e service nova] Creating event network-vif-deleted:1aacc717-6271-4f4c-bcb6-cd5e9ce523bd for instance 360f8059-fa58-4972-a431-b0822d419e4e on hv-cinder-85282 Aug 12 12:02:02.971393 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-a93021b8-4d27-4701-ad42-1d03b9edf5e4 req-aa15b8ac-0d06-40a6-8cd6-7743fb43547e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118497 Aug 12 12:02:02.976159 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 536/1073] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 12:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:02:03.486458 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-a015f3ee-b94f-4761-96c0-e6b3bcb1b891 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:02:03.487228 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-a015f3ee-b94f-4761-96c0-e6b3bcb1b891 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 360f8059-fa58-4972-a431-b0822d419e4e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:02:03.494228 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a015f3ee-b94f-4761-96c0-e6b3bcb1b891 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:03.494877 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a015f3ee-b94f-4761-96c0-e6b3bcb1b891 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:03.495286 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a015f3ee-b94f-4761-96c0-e6b3bcb1b891 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:03.495985 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a015f3ee-b94f-4761-96c0-e6b3bcb1b891 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:03.496432 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a015f3ee-b94f-4761-96c0-e6b3bcb1b891 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:03.496852 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a015f3ee-b94f-4761-96c0-e6b3bcb1b891 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:03.529307 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a015f3ee-b94f-4761-96c0-e6b3bcb1b891 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:03.529780 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a015f3ee-b94f-4761-96c0-e6b3bcb1b891 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:03.530207 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a015f3ee-b94f-4761-96c0-e6b3bcb1b891 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:03.530710 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.objects.instance [None req-a015f3ee-b94f-4761-96c0-e6b3bcb1b891 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lazy-loading 'fault' on Instance uuid 360f8059-fa58-4972-a431-b0822d419e4e {{(pid=132281) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:02:03.572191 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-a015f3ee-b94f-4761-96c0-e6b3bcb1b891 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:02:03.580447 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-a015f3ee-b94f-4761-96c0-e6b3bcb1b891 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e" status: 200 len: 1230 microversion: 2.1 time: 0.097952 Aug 12 12:02:03.581022 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 538/1074] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:02:03 2022] GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:02:04.601867 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e5dc749d-9d22-404f-9c06-f8fd354c5f35 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:02:04.602563 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-e5dc749d-9d22-404f-9c06-f8fd354c5f35 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 360f8059-fa58-4972-a431-b0822d419e4e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:02:04.609135 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e5dc749d-9d22-404f-9c06-f8fd354c5f35 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:04.609611 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e5dc749d-9d22-404f-9c06-f8fd354c5f35 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:04.610046 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e5dc749d-9d22-404f-9c06-f8fd354c5f35 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:04.610772 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e5dc749d-9d22-404f-9c06-f8fd354c5f35 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:04.611228 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e5dc749d-9d22-404f-9c06-f8fd354c5f35 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:04.611655 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e5dc749d-9d22-404f-9c06-f8fd354c5f35 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:04.624662 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.wsgi [None req-e5dc749d-9d22-404f-9c06-f8fd354c5f35 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] HTTP exception thrown: Instance 360f8059-fa58-4972-a431-b0822d419e4e could not be found. Aug 12 12:02:04.626252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e5dc749d-9d22-404f-9c06-f8fd354c5f35 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Request method failure captured: Aug 12 12:02:04.626252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e HTTP/1.1 Aug 12 12:02:04.626252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 12:02:04.626252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 12:02:04.626252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 12:02:04.626252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 0 Aug 12 12:02:04.626252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 12:02:04.626252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 12:02:04.626252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 12:02:04.626252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 12:02:04.626252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9kCanZ2V3Hc8cbSf84Jj7mUX8xXh6hOIJFbhQgyOcYxiWBVkHcH-Yjf1_gAEi1-i-BvXnlv354cGQLkK6yxbOCjBNznt0iFvL2uiVERCq4ckSRTn0F5aKpSoenkZR3VgjbiDim6lc8w3-IdWaccR9UKmoEBvC3jma7ZwwVH5pcNCX4o Aug 12 12:02:04.626252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 12:02:04.626252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 12:02:04.626252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 12:02:04.626252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 12:02:04.626252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 12:02:04.626252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 12:02:04.626252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: 45a982b3e219420fb17c07b591042992 Aug 12 12:02:04.626252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-TestVolumeBootPattern-1893673039 Aug 12 12:02:04.626252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 12:02:04.626252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 12:02:04.628025 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_45a982b3e219420fb17c07b591042992", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/45a982b3e219420fb17c07b591042992"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/45a982b3e219420fb17c07b591042992"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/45a982b3e219420fb17c07b591042992"}]}] Aug 12 12:02:04.628025 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-TestVolumeBootPattern-1893673039 Aug 12 12:02:04.628025 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: 45a982b3e219420fb17c07b591042992 Aug 12 12:02:04.628025 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-TestVolumeBootPattern-1893673039 Aug 12 12:02:04.628025 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-TestVolumeBootPattern-1893673039-project Aug 12 12:02:04.628025 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 12:02:04.628025 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 12:02:04.628025 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: bd3289f4fa7745ceb12f4d5cd7f901c6 Aug 12 12:02:04.628025 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-TestVolumeBootPattern-1893673039-project Aug 12 12:02:04.628025 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: > Aug 12 12:02:04.628025 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Instance 360f8059-fa58-4972-a431-b0822d419e4e could not be found. Aug 12 12:02:04.628025 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'id': '360f8059-fa58-4972-a431-b0822d419e4e'} Aug 12 12:02:04.629082 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:02:04.629082 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:02:04.629082 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:02:04.629082 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:02:04.629082 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:02:04.629082 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:02:04.629082 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:02:04.629082 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:02:04.629082 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:02:04.629082 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:02:04.629082 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 360f8059-fa58-4972-a431-b0822d419e4e could not be found. Aug 12 12:02:04.629082 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 12:02:04.629082 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:02:04.629082 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 12:02:04.629082 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:02:04.629082 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:02:04.629082 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:02:04.629082 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:02:04.629082 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:02:04.629082 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:02:04.630749 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:02:04.630749 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:02:04.630749 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:02:04.630749 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:02:04.630749 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:02:04.630749 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:02:04.630749 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:02:04.630749 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 360f8059-fa58-4972-a431-b0822d419e4e could not be found. Aug 12 12:02:04.630749 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 12:02:04.630749 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:02:04.630749 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 12:02:04.630749 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:02:04.630749 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:02:04.630749 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:02:04.630749 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:02:04.630749 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:02:04.630749 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 360f8059-fa58-4972-a431-b0822d419e4e could not be found. Aug 12 12:02:04.630749 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 12:02:04.632177 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e5dc749d-9d22-404f-9c06-f8fd354c5f35 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Returning 404 to user: Instance 360f8059-fa58-4972-a431-b0822d419e4e could not be found. {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:02:04.632177 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e5dc749d-9d22-404f-9c06-f8fd354c5f35 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e" status: 404 len: 111 microversion: 2.1 time: 0.030019 Aug 12 12:02:04.632177 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 537/1075] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:02:04 2022] GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:02:04.675448 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-b5d6cb86-65aa-4418-bb68-dc373259968c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1824059340", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1684938935", "security_groups": [{"name": "tempest-secgroup-smoke-1389924360"}], "block_device_mapping_v2": [{"uuid": "26314bad-2bb7-45f8-9d47-aad3a4698592", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d2756a4f-409c-444c-908b-ef5d0ae82e6c"}]}} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:02:04.786341 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.network.neutron [None req-b5d6cb86-65aa-4418-bb68-dc373259968c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] validate_networks() for [('d2756a4f-409c-444c-908b-ef5d0ae82e6c', None, None, None, None, None)] {{(pid=132281) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 12:02:05.216606 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-b5d6cb86-65aa-4418-bb68-dc373259968c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Flavor limits 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 12:02:05.217052 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-b5d6cb86-65aa-4418-bb68-dc373259968c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Image limits 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 12:02:05.217520 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-b5d6cb86-65aa-4418-bb68-dc373259968c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Flavor pref 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 12:02:05.218007 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-b5d6cb86-65aa-4418-bb68-dc373259968c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Image pref 0:0:0 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 12:02:05.218429 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.virt.hardware [None req-b5d6cb86-65aa-4418-bb68-dc373259968c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132281) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 12:02:05.227296 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b5d6cb86-65aa-4418-bb68-dc373259968c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:05.227768 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b5d6cb86-65aa-4418-bb68-dc373259968c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:05.228190 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b5d6cb86-65aa-4418-bb68-dc373259968c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:05.228928 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b5d6cb86-65aa-4418-bb68-dc373259968c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:05.229373 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b5d6cb86-65aa-4418-bb68-dc373259968c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:05.229790 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-b5d6cb86-65aa-4418-bb68-dc373259968c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:05.246058 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.quota [None req-b5d6cb86-65aa-4418-bb68-dc373259968c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Getting quotas for project 45a982b3e219420fb17c07b591042992. Resources: {'instances', 'ram', 'cores'} {{(pid=132281) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:02:05.250450 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.quota [None req-b5d6cb86-65aa-4418-bb68-dc373259968c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Getting quotas for user bd3289f4fa7745ceb12f4d5cd7f901c6 and project 45a982b3e219420fb17c07b591042992. Resources: {'instances', 'ram', 'cores'} {{(pid=132281) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:02:05.305636 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-b5d6cb86-65aa-4418-bb68-dc373259968c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Going to run 1 instances... {{(pid=132281) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 12:02:05.307743 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-b5d6cb86-65aa-4418-bb68-dc373259968c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 401b05d6-33dc-4696-926c-0bb13eff3a17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='26314bad-2bb7-45f8-9d47-aad3a4698592',volume_size=None,volume_type=None)] {{(pid=132281) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 12:02:05.435068 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-b5d6cb86-65aa-4418-bb68-dc373259968c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.763370 Aug 12 12:02:05.436010 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 539/1076] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Aug 12 12:02:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 12:02:05.447542 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-87f79cc7-11e6-4dca-acab-2fbc4f4d6a09 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:02:05.448426 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-87f79cc7-11e6-4dca-acab-2fbc4f4d6a09 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 401b05d6-33dc-4696-926c-0bb13eff3a17] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:02:05.507585 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-87f79cc7-11e6-4dca-acab-2fbc4f4d6a09 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:02:05.514124 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-87f79cc7-11e6-4dca-acab-2fbc4f4d6a09 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17" status: 200 len: 1095 microversion: 2.1 time: 0.070421 Aug 12 12:02:05.514706 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 538/1077] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:02:05 2022] GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17 => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:02:06.534151 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-4f0824b6-a45f-445f-8fb7-8e26e2fa7b07 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:02:06.534788 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-4f0824b6-a45f-445f-8fb7-8e26e2fa7b07 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 401b05d6-33dc-4696-926c-0bb13eff3a17] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:02:06.541665 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4f0824b6-a45f-445f-8fb7-8e26e2fa7b07 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:06.542154 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4f0824b6-a45f-445f-8fb7-8e26e2fa7b07 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:06.542837 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4f0824b6-a45f-445f-8fb7-8e26e2fa7b07 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:06.543563 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4f0824b6-a45f-445f-8fb7-8e26e2fa7b07 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:06.544024 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4f0824b6-a45f-445f-8fb7-8e26e2fa7b07 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:06.544449 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4f0824b6-a45f-445f-8fb7-8e26e2fa7b07 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:06.625301 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-4f0824b6-a45f-445f-8fb7-8e26e2fa7b07 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:02:06.633547 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-4f0824b6-a45f-445f-8fb7-8e26e2fa7b07 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17" status: 200 len: 1201 microversion: 2.1 time: 0.103766 Aug 12 12:02:06.634332 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 540/1078] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:02:06 2022] GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17 => generated 1201 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:02:07.654965 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-ed441aa6-0bff-4af4-83a0-f8bf4627cd43 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:02:07.655711 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-ed441aa6-0bff-4af4-83a0-f8bf4627cd43 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 401b05d6-33dc-4696-926c-0bb13eff3a17] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:02:07.664261 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ed441aa6-0bff-4af4-83a0-f8bf4627cd43 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:07.664755 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ed441aa6-0bff-4af4-83a0-f8bf4627cd43 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:07.665207 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ed441aa6-0bff-4af4-83a0-f8bf4627cd43 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:07.666144 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ed441aa6-0bff-4af4-83a0-f8bf4627cd43 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:07.666932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ed441aa6-0bff-4af4-83a0-f8bf4627cd43 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:07.667409 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ed441aa6-0bff-4af4-83a0-f8bf4627cd43 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:07.878689 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-ed441aa6-0bff-4af4-83a0-f8bf4627cd43 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:02:07.886279 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-ed441aa6-0bff-4af4-83a0-f8bf4627cd43 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17" status: 200 len: 1267 microversion: 2.1 time: 0.235261 Aug 12 12:02:07.886873 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 539/1079] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:02:07 2022] GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17 => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:02:07.973529 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-4c9725ea-7f78-4faa-8183-b333b259f04f req-664937ef-7417-4058-8962-063c731b07e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "401b05d6-33dc-4696-926c-0bb13eff3a17", "tag": "d4449365-be8a-41c1-88d7-21ddec20bd52"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:02:07.983379 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-4c9725ea-7f78-4faa-8183-b333b259f04f req-664937ef-7417-4058-8962-063c731b07e0 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:07.984074 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-4c9725ea-7f78-4faa-8183-b333b259f04f req-664937ef-7417-4058-8962-063c731b07e0 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:07.984684 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-4c9725ea-7f78-4faa-8183-b333b259f04f req-664937ef-7417-4058-8962-063c731b07e0 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:07.996122 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-4c9725ea-7f78-4faa-8183-b333b259f04f req-664937ef-7417-4058-8962-063c731b07e0 service nova] Creating event network-changed:d4449365-be8a-41c1-88d7-21ddec20bd52 for instance 401b05d6-33dc-4696-926c-0bb13eff3a17 on hv-cinder-85282 Aug 12 12:02:08.001382 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-4c9725ea-7f78-4faa-8183-b333b259f04f req-664937ef-7417-4058-8962-063c731b07e0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031071 Aug 12 12:02:08.001969 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 541/1080] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 12:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:02:08.907393 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-80d927f4-98ce-4d07-8796-53c085c8f947 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:02:08.908021 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-80d927f4-98ce-4d07-8796-53c085c8f947 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 401b05d6-33dc-4696-926c-0bb13eff3a17] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:02:08.914371 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-80d927f4-98ce-4d07-8796-53c085c8f947 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:08.914887 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-80d927f4-98ce-4d07-8796-53c085c8f947 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:08.915326 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-80d927f4-98ce-4d07-8796-53c085c8f947 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:08.916018 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-80d927f4-98ce-4d07-8796-53c085c8f947 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:08.916496 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-80d927f4-98ce-4d07-8796-53c085c8f947 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:08.916923 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-80d927f4-98ce-4d07-8796-53c085c8f947 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:09.127878 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-80d927f4-98ce-4d07-8796-53c085c8f947 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:02:09.135923 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-80d927f4-98ce-4d07-8796-53c085c8f947 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17" status: 200 len: 1267 microversion: 2.1 time: 0.232892 Aug 12 12:02:09.136575 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 540/1081] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:02:08 2022] GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17 => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:02:10.158439 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-86e63d69-c7fe-4167-b772-1154f141e2c6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:02:10.159071 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-86e63d69-c7fe-4167-b772-1154f141e2c6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 401b05d6-33dc-4696-926c-0bb13eff3a17] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:02:10.165184 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86e63d69-c7fe-4167-b772-1154f141e2c6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:10.165658 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86e63d69-c7fe-4167-b772-1154f141e2c6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:10.166084 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86e63d69-c7fe-4167-b772-1154f141e2c6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:10.166790 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86e63d69-c7fe-4167-b772-1154f141e2c6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:10.167237 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86e63d69-c7fe-4167-b772-1154f141e2c6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:10.167653 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-86e63d69-c7fe-4167-b772-1154f141e2c6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:10.296901 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-86e63d69-c7fe-4167-b772-1154f141e2c6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:02:10.304818 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-86e63d69-c7fe-4167-b772-1154f141e2c6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17" status: 200 len: 1267 microversion: 2.1 time: 0.151386 Aug 12 12:02:10.305381 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 542/1082] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:02:10 2022] GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:02:11.325278 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-c327023f-8e73-4475-8010-52810bebd747 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:02:11.325892 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-c327023f-8e73-4475-8010-52810bebd747 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 401b05d6-33dc-4696-926c-0bb13eff3a17] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:02:11.332906 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c327023f-8e73-4475-8010-52810bebd747 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:11.333388 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c327023f-8e73-4475-8010-52810bebd747 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:11.333822 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c327023f-8e73-4475-8010-52810bebd747 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:11.334506 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c327023f-8e73-4475-8010-52810bebd747 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:11.334986 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c327023f-8e73-4475-8010-52810bebd747 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:11.335412 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c327023f-8e73-4475-8010-52810bebd747 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:11.463960 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-c327023f-8e73-4475-8010-52810bebd747 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:02:11.471958 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-c327023f-8e73-4475-8010-52810bebd747 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17" status: 200 len: 1267 microversion: 2.1 time: 0.150531 Aug 12 12:02:11.472516 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 541/1083] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:02:11 2022] GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:02:12.492619 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-a5c7782a-8395-4371-ad22-3dee16262f79 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:02:12.493225 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-a5c7782a-8395-4371-ad22-3dee16262f79 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 401b05d6-33dc-4696-926c-0bb13eff3a17] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:02:12.499691 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a5c7782a-8395-4371-ad22-3dee16262f79 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:12.500168 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a5c7782a-8395-4371-ad22-3dee16262f79 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:12.500703 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a5c7782a-8395-4371-ad22-3dee16262f79 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:12.501673 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a5c7782a-8395-4371-ad22-3dee16262f79 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:12.502168 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a5c7782a-8395-4371-ad22-3dee16262f79 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:12.502585 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-a5c7782a-8395-4371-ad22-3dee16262f79 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:12.634543 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-a5c7782a-8395-4371-ad22-3dee16262f79 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:02:12.641948 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-a5c7782a-8395-4371-ad22-3dee16262f79 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17" status: 200 len: 1267 microversion: 2.1 time: 0.153205 Aug 12 12:02:12.642488 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 543/1084] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:02:12 2022] GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:02:13.663079 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-760c016a-f193-44a1-8531-59800b85335e tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:02:13.663640 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-760c016a-f193-44a1-8531-59800b85335e tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 401b05d6-33dc-4696-926c-0bb13eff3a17] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:02:13.669942 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-760c016a-f193-44a1-8531-59800b85335e tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:13.670417 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-760c016a-f193-44a1-8531-59800b85335e tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:13.670888 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-760c016a-f193-44a1-8531-59800b85335e tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:13.671567 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-760c016a-f193-44a1-8531-59800b85335e tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:13.672017 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-760c016a-f193-44a1-8531-59800b85335e tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:13.672950 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-760c016a-f193-44a1-8531-59800b85335e tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:13.802685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-760c016a-f193-44a1-8531-59800b85335e tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:02:13.809986 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-760c016a-f193-44a1-8531-59800b85335e tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17" status: 200 len: 1267 microversion: 2.1 time: 0.151409 Aug 12 12:02:13.810550 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 542/1085] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:02:13 2022] GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:02:14.832870 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e8c9fc85-13b0-4da6-96bb-034676b6d2ea tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:02:14.833476 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-e8c9fc85-13b0-4da6-96bb-034676b6d2ea tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 401b05d6-33dc-4696-926c-0bb13eff3a17] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:02:14.839839 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e8c9fc85-13b0-4da6-96bb-034676b6d2ea tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:14.840314 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e8c9fc85-13b0-4da6-96bb-034676b6d2ea tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:14.840738 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e8c9fc85-13b0-4da6-96bb-034676b6d2ea tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:14.841414 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e8c9fc85-13b0-4da6-96bb-034676b6d2ea tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:14.841862 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e8c9fc85-13b0-4da6-96bb-034676b6d2ea tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:14.842275 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e8c9fc85-13b0-4da6-96bb-034676b6d2ea tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:14.975252 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-e8c9fc85-13b0-4da6-96bb-034676b6d2ea tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:02:14.982671 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-e8c9fc85-13b0-4da6-96bb-034676b6d2ea tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17" status: 200 len: 1267 microversion: 2.1 time: 0.154881 Aug 12 12:02:14.983232 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 544/1086] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:02:14 2022] GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:02:16.003126 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-a1fb1185-4a06-4bec-9597-bf507b5723bf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:02:16.003736 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-a1fb1185-4a06-4bec-9597-bf507b5723bf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 401b05d6-33dc-4696-926c-0bb13eff3a17] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:02:16.006197 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=2 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:16.011598 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a1fb1185-4a06-4bec-9597-bf507b5723bf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:16.012080 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a1fb1185-4a06-4bec-9597-bf507b5723bf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:16.012529 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a1fb1185-4a06-4bec-9597-bf507b5723bf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:16.013220 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a1fb1185-4a06-4bec-9597-bf507b5723bf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:16.013670 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a1fb1185-4a06-4bec-9597-bf507b5723bf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:16.014124 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a1fb1185-4a06-4bec-9597-bf507b5723bf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:16.145092 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-a1fb1185-4a06-4bec-9597-bf507b5723bf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:02:16.152569 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-a1fb1185-4a06-4bec-9597-bf507b5723bf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17" status: 200 len: 1267 microversion: 2.1 time: 0.153175 Aug 12 12:02:16.153161 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 543/1087] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:02:15 2022] GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:02:17.174299 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-d977cc7a-a862-4086-9e86-2914637ab3ca tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:02:17.174860 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-d977cc7a-a862-4086-9e86-2914637ab3ca tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 401b05d6-33dc-4696-926c-0bb13eff3a17] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:02:17.176743 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell0:SELECT=2 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:17.177399 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell0:SELECT=6 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:17.184331 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d977cc7a-a862-4086-9e86-2914637ab3ca tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:17.184812 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d977cc7a-a862-4086-9e86-2914637ab3ca tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:17.185245 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d977cc7a-a862-4086-9e86-2914637ab3ca tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:17.185934 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d977cc7a-a862-4086-9e86-2914637ab3ca tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:17.186382 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d977cc7a-a862-4086-9e86-2914637ab3ca tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:17.186842 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-d977cc7a-a862-4086-9e86-2914637ab3ca tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:17.323928 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-d977cc7a-a862-4086-9e86-2914637ab3ca tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:02:17.331776 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-d977cc7a-a862-4086-9e86-2914637ab3ca tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17" status: 200 len: 1267 microversion: 2.1 time: 0.161987 Aug 12 12:02:17.332333 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 545/1088] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:02:17 2022] GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:02:17.651754 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-148c673b-34d0-4e90-8c75-83360944bff6 req-bdcd77ff-7363-4115-985a-4a3d9318790b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "401b05d6-33dc-4696-926c-0bb13eff3a17", "name": "network-vif-plugged", "status": "completed", "tag": "d4449365-be8a-41c1-88d7-21ddec20bd52"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:02:17.662207 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-148c673b-34d0-4e90-8c75-83360944bff6 req-bdcd77ff-7363-4115-985a-4a3d9318790b service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:17.662774 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-148c673b-34d0-4e90-8c75-83360944bff6 req-bdcd77ff-7363-4115-985a-4a3d9318790b service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:17.663221 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-148c673b-34d0-4e90-8c75-83360944bff6 req-bdcd77ff-7363-4115-985a-4a3d9318790b service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:17.674520 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-148c673b-34d0-4e90-8c75-83360944bff6 req-bdcd77ff-7363-4115-985a-4a3d9318790b service nova] Creating event network-vif-plugged:d4449365-be8a-41c1-88d7-21ddec20bd52 for instance 401b05d6-33dc-4696-926c-0bb13eff3a17 on hv-cinder-85282 Aug 12 12:02:17.679647 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-148c673b-34d0-4e90-8c75-83360944bff6 req-bdcd77ff-7363-4115-985a-4a3d9318790b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031744 Aug 12 12:02:17.680595 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 544/1089] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 12:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:02:18.352916 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e839581e-8511-4f6a-8c34-cc017bdd3ff3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:02:18.353562 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-e839581e-8511-4f6a-8c34-cc017bdd3ff3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 401b05d6-33dc-4696-926c-0bb13eff3a17] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:02:18.360507 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e839581e-8511-4f6a-8c34-cc017bdd3ff3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:18.360990 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e839581e-8511-4f6a-8c34-cc017bdd3ff3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:18.361422 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e839581e-8511-4f6a-8c34-cc017bdd3ff3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:18.362109 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e839581e-8511-4f6a-8c34-cc017bdd3ff3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:18.362561 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e839581e-8511-4f6a-8c34-cc017bdd3ff3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:18.363006 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-e839581e-8511-4f6a-8c34-cc017bdd3ff3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:18.489528 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-e839581e-8511-4f6a-8c34-cc017bdd3ff3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:02:18.497032 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-e839581e-8511-4f6a-8c34-cc017bdd3ff3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17" status: 200 len: 1267 microversion: 2.1 time: 0.148037 Aug 12 12:02:18.497604 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 546/1090] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:02:18 2022] GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:02:19.518868 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-4daa0f3c-6243-4ffc-a941-671d4ca650cf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:02:19.519563 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-4daa0f3c-6243-4ffc-a941-671d4ca650cf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 401b05d6-33dc-4696-926c-0bb13eff3a17] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:02:19.525683 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4daa0f3c-6243-4ffc-a941-671d4ca650cf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:19.526158 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4daa0f3c-6243-4ffc-a941-671d4ca650cf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:19.526804 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4daa0f3c-6243-4ffc-a941-671d4ca650cf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:19.527330 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4daa0f3c-6243-4ffc-a941-671d4ca650cf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:19.527778 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4daa0f3c-6243-4ffc-a941-671d4ca650cf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:19.528197 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-4daa0f3c-6243-4ffc-a941-671d4ca650cf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:19.661700 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-4daa0f3c-6243-4ffc-a941-671d4ca650cf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:02:19.669176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-4daa0f3c-6243-4ffc-a941-671d4ca650cf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17" status: 200 len: 1267 microversion: 2.1 time: 0.155637 Aug 12 12:02:19.669726 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 545/1091] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:02:19 2022] GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:02:20.691094 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-74420b73-ec18-4713-8a9c-87e57359323a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:02:20.691678 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-74420b73-ec18-4713-8a9c-87e57359323a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 401b05d6-33dc-4696-926c-0bb13eff3a17] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:02:20.698027 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-74420b73-ec18-4713-8a9c-87e57359323a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:20.698499 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-74420b73-ec18-4713-8a9c-87e57359323a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:20.698956 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-74420b73-ec18-4713-8a9c-87e57359323a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:20.699633 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-74420b73-ec18-4713-8a9c-87e57359323a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:20.700078 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-74420b73-ec18-4713-8a9c-87e57359323a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:20.700487 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-74420b73-ec18-4713-8a9c-87e57359323a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:20.827942 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-74420b73-ec18-4713-8a9c-87e57359323a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:02:20.836150 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-74420b73-ec18-4713-8a9c-87e57359323a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17" status: 200 len: 1455 microversion: 2.1 time: 0.149749 Aug 12 12:02:20.836762 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 547/1092] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:02:20 2022] GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17 => generated 1455 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:02:20.855938 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-ea4d2a6d-42dd-48ee-b04a-0c70c82b2d01 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:02:20.856552 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-ea4d2a6d-42dd-48ee-b04a-0c70c82b2d01 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 401b05d6-33dc-4696-926c-0bb13eff3a17] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:02:20.862994 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ea4d2a6d-42dd-48ee-b04a-0c70c82b2d01 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:20.863477 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ea4d2a6d-42dd-48ee-b04a-0c70c82b2d01 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:20.863916 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ea4d2a6d-42dd-48ee-b04a-0c70c82b2d01 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:20.864610 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ea4d2a6d-42dd-48ee-b04a-0c70c82b2d01 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:20.865061 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ea4d2a6d-42dd-48ee-b04a-0c70c82b2d01 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:20.865485 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ea4d2a6d-42dd-48ee-b04a-0c70c82b2d01 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:20.994323 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-ea4d2a6d-42dd-48ee-b04a-0c70c82b2d01 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:02:21.002250 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-ea4d2a6d-42dd-48ee-b04a-0c70c82b2d01 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17" status: 200 len: 1455 microversion: 2.1 time: 0.150136 Aug 12 12:02:21.002832 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 546/1093] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:02:20 2022] GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17 => generated 1455 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:02:22.793592 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-65b26bc2-ef5e-4128-a1e5-35e2b6554c9a req-a469ef1a-8261-4abf-a3b0-bc1184047f35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "401b05d6-33dc-4696-926c-0bb13eff3a17", "tag": "d4449365-be8a-41c1-88d7-21ddec20bd52"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:02:22.803877 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-65b26bc2-ef5e-4128-a1e5-35e2b6554c9a req-a469ef1a-8261-4abf-a3b0-bc1184047f35 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:22.804431 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-65b26bc2-ef5e-4128-a1e5-35e2b6554c9a req-a469ef1a-8261-4abf-a3b0-bc1184047f35 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:22.804858 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-65b26bc2-ef5e-4128-a1e5-35e2b6554c9a req-a469ef1a-8261-4abf-a3b0-bc1184047f35 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:22.816896 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-65b26bc2-ef5e-4128-a1e5-35e2b6554c9a req-a469ef1a-8261-4abf-a3b0-bc1184047f35 service nova] Creating event network-changed:d4449365-be8a-41c1-88d7-21ddec20bd52 for instance 401b05d6-33dc-4696-926c-0bb13eff3a17 on hv-cinder-85282 Aug 12 12:02:22.821904 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-65b26bc2-ef5e-4128-a1e5-35e2b6554c9a req-a469ef1a-8261-4abf-a3b0-bc1184047f35 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031936 Aug 12 12:02:22.822479 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 548/1094] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 12:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:02:40.902470 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:40.903228 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=68 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:40.908563 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-af5ba05e-5140-451e-9220-b2992cb19abf req-f8c28f65-ffe3-4c0f-a744-f44825783a17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9e68aca-3dd9-485f-b14f-fc3b9face4fd", "tag": "eac729c6-2ebe-467e-bcc1-a5afd019c575"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:02:40.913595 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e5e670e3-28b7-48d5-9866-8417aa2fa5bf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:02:40.914418 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-e5e670e3-28b7-48d5-9866-8417aa2fa5bf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:02:40.918148 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:40.919239 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:40.924363 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e5e670e3-28b7-48d5-9866-8417aa2fa5bf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:40.924855 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e5e670e3-28b7-48d5-9866-8417aa2fa5bf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:40.925291 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e5e670e3-28b7-48d5-9866-8417aa2fa5bf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:40.925993 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e5e670e3-28b7-48d5-9866-8417aa2fa5bf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:40.926448 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e5e670e3-28b7-48d5-9866-8417aa2fa5bf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:40.926939 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e5e670e3-28b7-48d5-9866-8417aa2fa5bf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:40.929582 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-af5ba05e-5140-451e-9220-b2992cb19abf req-f8c28f65-ffe3-4c0f-a744-f44825783a17 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:40.930038 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-af5ba05e-5140-451e-9220-b2992cb19abf req-f8c28f65-ffe3-4c0f-a744-f44825783a17 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:40.930461 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-af5ba05e-5140-451e-9220-b2992cb19abf req-f8c28f65-ffe3-4c0f-a744-f44825783a17 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:40.943689 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-af5ba05e-5140-451e-9220-b2992cb19abf req-f8c28f65-ffe3-4c0f-a744-f44825783a17 service nova] Creating event network-changed:eac729c6-2ebe-467e-bcc1-a5afd019c575 for instance f9e68aca-3dd9-485f-b14f-fc3b9face4fd on hv-cinder-85282 Aug 12 12:02:40.948543 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-af5ba05e-5140-451e-9220-b2992cb19abf req-f8c28f65-ffe3-4c0f-a744-f44825783a17 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047352 Aug 12 12:02:40.949362 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 549/1095] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 12:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:02:40.957118 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-e5e670e3-28b7-48d5-9866-8417aa2fa5bf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Going to try to terminate instance {{(pid=132282) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 12:02:41.041424 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e5e670e3-28b7-48d5-9866-8417aa2fa5bf tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 204 len: 0 microversion: 2.1 time: 0.143023 Aug 12 12:02:41.041867 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 547/1096] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Aug 12 12:02:40 2022] DELETE /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 12:02:41.052664 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-78cabbec-322f-4a79-a81b-ebf358def215 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:02:41.053700 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-78cabbec-322f-4a79-a81b-ebf358def215 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:02:41.062119 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-78cabbec-322f-4a79-a81b-ebf358def215 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:41.063160 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-78cabbec-322f-4a79-a81b-ebf358def215 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:41.063915 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-78cabbec-322f-4a79-a81b-ebf358def215 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:41.065208 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-78cabbec-322f-4a79-a81b-ebf358def215 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:41.066314 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-78cabbec-322f-4a79-a81b-ebf358def215 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:41.067125 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-78cabbec-322f-4a79-a81b-ebf358def215 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:41.200638 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-78cabbec-322f-4a79-a81b-ebf358def215 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:02:41.208898 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-78cabbec-322f-4a79-a81b-ebf358def215 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1569 microversion: 2.1 time: 0.162263 Aug 12 12:02:41.209577 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 550/1097] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:02:41 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:02:42.229839 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-e2fad932-f599-4d86-8e1f-dcd497f0c363 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:02:42.230525 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-e2fad932-f599-4d86-8e1f-dcd497f0c363 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:02:42.236980 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e2fad932-f599-4d86-8e1f-dcd497f0c363 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:42.237461 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e2fad932-f599-4d86-8e1f-dcd497f0c363 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:42.237894 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e2fad932-f599-4d86-8e1f-dcd497f0c363 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:42.238629 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e2fad932-f599-4d86-8e1f-dcd497f0c363 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:42.239089 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e2fad932-f599-4d86-8e1f-dcd497f0c363 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:42.239513 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-e2fad932-f599-4d86-8e1f-dcd497f0c363 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:42.441851 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-e2fad932-f599-4d86-8e1f-dcd497f0c363 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:02:42.449935 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-e2fad932-f599-4d86-8e1f-dcd497f0c363 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1569 microversion: 2.1 time: 0.224407 Aug 12 12:02:42.450491 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 548/1098] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:02:42 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1569 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:02:43.472498 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-4e062c27-ddf7-4a4b-8613-0d7e14a7a959 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:02:43.473047 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-4e062c27-ddf7-4a4b-8613-0d7e14a7a959 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:02:43.479845 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4e062c27-ddf7-4a4b-8613-0d7e14a7a959 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:43.480324 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4e062c27-ddf7-4a4b-8613-0d7e14a7a959 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:43.480748 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4e062c27-ddf7-4a4b-8613-0d7e14a7a959 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:43.481465 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4e062c27-ddf7-4a4b-8613-0d7e14a7a959 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:43.481890 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4e062c27-ddf7-4a4b-8613-0d7e14a7a959 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:43.482302 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-4e062c27-ddf7-4a4b-8613-0d7e14a7a959 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:43.830545 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-4e062c27-ddf7-4a4b-8613-0d7e14a7a959 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:02:43.838100 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-4e062c27-ddf7-4a4b-8613-0d7e14a7a959 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1569 microversion: 2.1 time: 0.370459 Aug 12 12:02:43.838709 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 551/1099] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:02:43 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1569 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:02:44.039759 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-1349d443-7f3f-4e29-8bfe-cff0448f978f req-17cee1c2-3b81-41a8-bd4e-8459651b9659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9e68aca-3dd9-485f-b14f-fc3b9face4fd", "name": "network-vif-deleted", "tag": "eac729c6-2ebe-467e-bcc1-a5afd019c575"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:02:44.051061 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-1349d443-7f3f-4e29-8bfe-cff0448f978f req-17cee1c2-3b81-41a8-bd4e-8459651b9659 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:44.051543 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-1349d443-7f3f-4e29-8bfe-cff0448f978f req-17cee1c2-3b81-41a8-bd4e-8459651b9659 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:44.051970 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-1349d443-7f3f-4e29-8bfe-cff0448f978f req-17cee1c2-3b81-41a8-bd4e-8459651b9659 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:44.064837 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-1349d443-7f3f-4e29-8bfe-cff0448f978f req-17cee1c2-3b81-41a8-bd4e-8459651b9659 service nova] Creating event network-vif-deleted:eac729c6-2ebe-467e-bcc1-a5afd019c575 for instance f9e68aca-3dd9-485f-b14f-fc3b9face4fd on hv-cinder-85282 Aug 12 12:02:44.070721 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-1349d443-7f3f-4e29-8bfe-cff0448f978f req-17cee1c2-3b81-41a8-bd4e-8459651b9659 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034807 Aug 12 12:02:44.071328 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 549/1100] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 12:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:02:44.859760 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-51b80482-8847-464e-b49b-3bb0db33a58c tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:02:44.860561 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-51b80482-8847-464e-b49b-3bb0db33a58c tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:02:44.867833 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-51b80482-8847-464e-b49b-3bb0db33a58c tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:44.868311 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-51b80482-8847-464e-b49b-3bb0db33a58c tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:44.869264 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-51b80482-8847-464e-b49b-3bb0db33a58c tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:44.869414 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-51b80482-8847-464e-b49b-3bb0db33a58c tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:44.869831 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-51b80482-8847-464e-b49b-3bb0db33a58c tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:44.870246 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-51b80482-8847-464e-b49b-3bb0db33a58c tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:44.906535 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-51b80482-8847-464e-b49b-3bb0db33a58c tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:44.907108 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-51b80482-8847-464e-b49b-3bb0db33a58c tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:44.907653 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-51b80482-8847-464e-b49b-3bb0db33a58c tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:44.908193 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.objects.instance [None req-51b80482-8847-464e-b49b-3bb0db33a58c tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lazy-loading 'fault' on Instance uuid f9e68aca-3dd9-485f-b14f-fc3b9face4fd {{(pid=132281) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:02:44.949870 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-51b80482-8847-464e-b49b-3bb0db33a58c tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974aee8a8724bcd8278cd1fc8736b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c8262170e04920ae36e89e24656f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:02:44.957354 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-51b80482-8847-464e-b49b-3bb0db33a58c tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 200 len: 1223 microversion: 2.1 time: 0.102514 Aug 12 12:02:44.957930 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 552/1101] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:02:44 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 1223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:02:45.980109 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-2e921093-e045-4c93-9fa2-b11850991da1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:02:45.980805 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-2e921093-e045-4c93-9fa2-b11850991da1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] [instance: f9e68aca-3dd9-485f-b14f-fc3b9face4fd] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:02:45.987126 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2e921093-e045-4c93-9fa2-b11850991da1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:45.987604 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2e921093-e045-4c93-9fa2-b11850991da1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:45.988040 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2e921093-e045-4c93-9fa2-b11850991da1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:45.988722 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2e921093-e045-4c93-9fa2-b11850991da1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:02:45.989178 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2e921093-e045-4c93-9fa2-b11850991da1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:02:45.989600 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-2e921093-e045-4c93-9fa2-b11850991da1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:02:46.002570 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.wsgi [None req-2e921093-e045-4c93-9fa2-b11850991da1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] HTTP exception thrown: Instance f9e68aca-3dd9-485f-b14f-fc3b9face4fd could not be found. Aug 12 12:02:46.004184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-2e921093-e045-4c93-9fa2-b11850991da1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Request method failure captured: Aug 12 12:02:46.004184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd HTTP/1.1 Aug 12 12:02:46.004184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 12:02:46.004184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 12:02:46.004184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 12:02:46.004184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 0 Aug 12 12:02:46.004184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 12:02:46.004184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 12:02:46.004184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 12:02:46.004184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 12:02:46.004184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9kA57Gp0eZ5MjjE4XWwd1YqMMmVkOgO01GveNFuzIH0-NJhWO6fynBgLOl9hNS45oFO-A_iMojYxkNnxzusYHFMb7qdr5_pc4Ro9wV6ZPPD8w-qYwvB5Kj2KToHoFXB_1WRxaOiVHBYvUvBHt_dll9vEXDUAMLZGsPks0HPXciOb3ig Aug 12 12:02:46.004184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 12:02:46.004184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 12:02:46.004184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 12:02:46.004184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 12:02:46.004184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 12:02:46.004184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 12:02:46.004184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: 42c8262170e04920ae36e89e24656f7d Aug 12 12:02:46.004184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-TestShelveInstance-727994100 Aug 12 12:02:46.004184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 12:02:46.004184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 12:02:46.005872 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_42c8262170e04920ae36e89e24656f7d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/42c8262170e04920ae36e89e24656f7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/42c8262170e04920ae36e89e24656f7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/42c8262170e04920ae36e89e24656f7d"}]}] Aug 12 12:02:46.005872 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-TestShelveInstance-727994100 Aug 12 12:02:46.005872 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: 42c8262170e04920ae36e89e24656f7d Aug 12 12:02:46.005872 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-TestShelveInstance-727994100 Aug 12 12:02:46.005872 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-TestShelveInstance-727994100-project Aug 12 12:02:46.005872 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 12:02:46.005872 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 12:02:46.005872 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: 4974aee8a8724bcd8278cd1fc8736b05 Aug 12 12:02:46.005872 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-TestShelveInstance-727994100-project Aug 12 12:02:46.005872 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: > Aug 12 12:02:46.005872 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Instance f9e68aca-3dd9-485f-b14f-fc3b9face4fd could not be found. Aug 12 12:02:46.005872 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'id': 'f9e68aca-3dd9-485f-b14f-fc3b9face4fd'} Aug 12 12:02:46.007070 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:02:46.007070 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:02:46.007070 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:02:46.007070 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:02:46.007070 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:02:46.007070 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:02:46.007070 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:02:46.007070 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:02:46.007070 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:02:46.007070 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:02:46.007070 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9e68aca-3dd9-485f-b14f-fc3b9face4fd could not be found. Aug 12 12:02:46.007070 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 12:02:46.007070 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:02:46.007070 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 12:02:46.007070 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:02:46.007070 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:02:46.007070 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:02:46.007070 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:02:46.007070 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:02:46.007070 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:02:46.008837 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:02:46.008837 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:02:46.008837 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:02:46.008837 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:02:46.008837 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:02:46.008837 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:02:46.008837 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:02:46.008837 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9e68aca-3dd9-485f-b14f-fc3b9face4fd could not be found. Aug 12 12:02:46.008837 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 12:02:46.008837 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:02:46.008837 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 12:02:46.008837 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:02:46.008837 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:02:46.008837 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:02:46.008837 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:02:46.008837 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:02:46.008837 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9e68aca-3dd9-485f-b14f-fc3b9face4fd could not be found. Aug 12 12:02:46.008837 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 12:02:46.010269 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-2e921093-e045-4c93-9fa2-b11850991da1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Returning 404 to user: Instance f9e68aca-3dd9-485f-b14f-fc3b9face4fd could not be found. {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:02:46.010269 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-2e921093-e045-4c93-9fa2-b11850991da1 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd" status: 404 len: 111 microversion: 2.1 time: 0.030092 Aug 12 12:02:46.010269 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 550/1102] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:02:45 2022] GET /compute/v2.1/servers/f9e68aca-3dd9-485f-b14f-fc3b9face4fd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:02:46.166186 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-e015e7ae-bfa7-415e-a9ee-5dfa75459695 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] Calling method '.version_select at 0x7f3e58218c10>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:02:46.187554 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-e015e7ae-bfa7-415e-a9ee-5dfa75459695 tempest-TestShelveInstance-727994100 tempest-TestShelveInstance-727994100-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-738393314" status: 202 len: 0 microversion: 2.1 time: 0.024973 Aug 12 12:02:46.188148 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 553/1103] 10.222.0.42 () {58 vars in 1251 bytes} [Fri Aug 12 12:02:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-738393314 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:04:01.039300 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:01.040051 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:01.044247 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-98ea1493-9152-47e6-97f6-6af370436f9f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1822665062", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1684938935", "security_groups": [{"name": "tempest-secgroup-smoke-1389924360"}], "block_device_mapping_v2": [{"uuid": "2ad10d7a-30c1-4d1a-81e8-17ffb7292f46", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d2756a4f-409c-444c-908b-ef5d0ae82e6c"}]}} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:04:01.177693 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.network.neutron [None req-98ea1493-9152-47e6-97f6-6af370436f9f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] validate_networks() for [('d2756a4f-409c-444c-908b-ef5d0ae82e6c', None, None, None, None, None)] {{(pid=132282) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 12:04:01.647727 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-98ea1493-9152-47e6-97f6-6af370436f9f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Flavor limits 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 12:04:01.648143 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-98ea1493-9152-47e6-97f6-6af370436f9f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Image limits 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 12:04:01.648637 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-98ea1493-9152-47e6-97f6-6af370436f9f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Flavor pref 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 12:04:01.649042 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-98ea1493-9152-47e6-97f6-6af370436f9f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Image pref 0:0:0 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 12:04:01.649445 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.virt.hardware [None req-98ea1493-9152-47e6-97f6-6af370436f9f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 12:04:01.658707 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-98ea1493-9152-47e6-97f6-6af370436f9f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:01.659184 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-98ea1493-9152-47e6-97f6-6af370436f9f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:01.659697 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-98ea1493-9152-47e6-97f6-6af370436f9f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:01.660388 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-98ea1493-9152-47e6-97f6-6af370436f9f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:01.660853 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-98ea1493-9152-47e6-97f6-6af370436f9f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:01.661254 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-98ea1493-9152-47e6-97f6-6af370436f9f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:01.678336 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-98ea1493-9152-47e6-97f6-6af370436f9f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Getting quotas for project 45a982b3e219420fb17c07b591042992. Resources: {'instances', 'ram', 'cores'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:04:01.682203 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.quota [None req-98ea1493-9152-47e6-97f6-6af370436f9f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Getting quotas for user bd3289f4fa7745ceb12f4d5cd7f901c6 and project 45a982b3e219420fb17c07b591042992. Resources: {'instances', 'ram', 'cores'} {{(pid=132282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:04:01.739396 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-98ea1493-9152-47e6-97f6-6af370436f9f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Going to run 1 instances... {{(pid=132282) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 12:04:01.741579 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-98ea1493-9152-47e6-97f6-6af370436f9f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 11068e33-76d1-4b27-80a7-41eadfef6a45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2ad10d7a-30c1-4d1a-81e8-17ffb7292f46',volume_size=None,volume_type=None)] {{(pid=132282) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 12:04:01.877144 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-98ea1493-9152-47e6-97f6-6af370436f9f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.839515 Aug 12 12:04:01.877838 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 551/1104] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Aug 12 12:04:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 12:04:01.886463 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=22 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:01.887750 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:01.892091 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-7ac8e713-1eb9-4081-ba78-c89b88fa3177 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:04:01.892687 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-7ac8e713-1eb9-4081-ba78-c89b88fa3177 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 11068e33-76d1-4b27-80a7-41eadfef6a45] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:04:01.947342 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-7ac8e713-1eb9-4081-ba78-c89b88fa3177 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:04:01.954112 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-7ac8e713-1eb9-4081-ba78-c89b88fa3177 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45" status: 200 len: 1095 microversion: 2.1 time: 0.069605 Aug 12 12:04:01.954684 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 554/1105] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:04:01 2022] GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:04:02.974580 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-48ce6f56-d040-4095-a329-2537815de3bf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:04:02.975990 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-48ce6f56-d040-4095-a329-2537815de3bf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 11068e33-76d1-4b27-80a7-41eadfef6a45] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:04:02.983029 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-48ce6f56-d040-4095-a329-2537815de3bf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:02.983615 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-48ce6f56-d040-4095-a329-2537815de3bf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:02.984103 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-48ce6f56-d040-4095-a329-2537815de3bf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:02.985000 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-48ce6f56-d040-4095-a329-2537815de3bf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:02.985458 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-48ce6f56-d040-4095-a329-2537815de3bf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:02.985885 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-48ce6f56-d040-4095-a329-2537815de3bf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:03.059922 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-48ce6f56-d040-4095-a329-2537815de3bf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:04:03.067589 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-48ce6f56-d040-4095-a329-2537815de3bf tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45" status: 200 len: 1201 microversion: 2.1 time: 0.096853 Aug 12 12:04:03.078915 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 552/1106] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:04:02 2022] GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45 => generated 1201 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:04:04.091210 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-19ecba10-8344-44a9-b515-36e4745416f8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:04:04.091829 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-19ecba10-8344-44a9-b515-36e4745416f8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 11068e33-76d1-4b27-80a7-41eadfef6a45] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:04:04.099034 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-19ecba10-8344-44a9-b515-36e4745416f8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:04.099579 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-19ecba10-8344-44a9-b515-36e4745416f8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:04.100018 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-19ecba10-8344-44a9-b515-36e4745416f8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:04.100721 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-19ecba10-8344-44a9-b515-36e4745416f8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:04.101190 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-19ecba10-8344-44a9-b515-36e4745416f8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:04.101613 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-19ecba10-8344-44a9-b515-36e4745416f8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:04.307025 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-19ecba10-8344-44a9-b515-36e4745416f8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:04:04.314628 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-19ecba10-8344-44a9-b515-36e4745416f8 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45" status: 200 len: 1267 microversion: 2.1 time: 0.228490 Aug 12 12:04:04.315204 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 555/1107] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:04:04 2022] GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45 => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:04:04.488896 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [req-bd6ea61a-43cc-4c8a-bb99-7fa296984272 req-55ffd893-6934-472e-b1ec-aa689e94982c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11068e33-76d1-4b27-80a7-41eadfef6a45", "tag": "20e8b515-5f76-4ea3-84e8-009a88a673dc"}]} {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:04:04.499004 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-bd6ea61a-43cc-4c8a-bb99-7fa296984272 req-55ffd893-6934-472e-b1ec-aa689e94982c service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:04.499544 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-bd6ea61a-43cc-4c8a-bb99-7fa296984272 req-55ffd893-6934-472e-b1ec-aa689e94982c service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:04.500063 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [req-bd6ea61a-43cc-4c8a-bb99-7fa296984272 req-55ffd893-6934-472e-b1ec-aa689e94982c service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:04.511009 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.compute.server_external_events [req-bd6ea61a-43cc-4c8a-bb99-7fa296984272 req-55ffd893-6934-472e-b1ec-aa689e94982c service nova] Creating event network-changed:20e8b515-5f76-4ea3-84e8-009a88a673dc for instance 11068e33-76d1-4b27-80a7-41eadfef6a45 on hv-cinder-85282 Aug 12 12:04:04.516455 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [req-bd6ea61a-43cc-4c8a-bb99-7fa296984272 req-55ffd893-6934-472e-b1ec-aa689e94982c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031341 Aug 12 12:04:04.517056 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 553/1108] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 12:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:04:05.336421 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-6c0e2021-39f2-4576-ad8e-40966f8840c5 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:04:05.337063 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-6c0e2021-39f2-4576-ad8e-40966f8840c5 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 11068e33-76d1-4b27-80a7-41eadfef6a45] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:04:05.343514 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6c0e2021-39f2-4576-ad8e-40966f8840c5 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:05.343990 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6c0e2021-39f2-4576-ad8e-40966f8840c5 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:05.344420 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6c0e2021-39f2-4576-ad8e-40966f8840c5 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:05.345100 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6c0e2021-39f2-4576-ad8e-40966f8840c5 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:05.345542 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6c0e2021-39f2-4576-ad8e-40966f8840c5 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:05.345953 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-6c0e2021-39f2-4576-ad8e-40966f8840c5 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:05.567131 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-6c0e2021-39f2-4576-ad8e-40966f8840c5 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:04:05.575323 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-6c0e2021-39f2-4576-ad8e-40966f8840c5 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45" status: 200 len: 1267 microversion: 2.1 time: 0.242186 Aug 12 12:04:05.575898 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 556/1109] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:04:05 2022] GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45 => generated 1267 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:04:06.597482 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-b4cb5a43-b352-4cbe-8c1a-10ebd761e213 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:04:06.598169 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-b4cb5a43-b352-4cbe-8c1a-10ebd761e213 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 11068e33-76d1-4b27-80a7-41eadfef6a45] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:04:06.604240 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b4cb5a43-b352-4cbe-8c1a-10ebd761e213 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:06.604715 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b4cb5a43-b352-4cbe-8c1a-10ebd761e213 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:06.605145 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b4cb5a43-b352-4cbe-8c1a-10ebd761e213 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:06.605822 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b4cb5a43-b352-4cbe-8c1a-10ebd761e213 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:06.606269 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b4cb5a43-b352-4cbe-8c1a-10ebd761e213 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:06.606722 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b4cb5a43-b352-4cbe-8c1a-10ebd761e213 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:06.734343 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-b4cb5a43-b352-4cbe-8c1a-10ebd761e213 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:04:06.741774 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-b4cb5a43-b352-4cbe-8c1a-10ebd761e213 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45" status: 200 len: 1267 microversion: 2.1 time: 0.148847 Aug 12 12:04:06.742329 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 554/1110] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:04:06 2022] GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:04:07.762298 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-3ea19d13-ed6f-4de9-88bd-ba1516d51ce6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:04:07.762973 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-3ea19d13-ed6f-4de9-88bd-ba1516d51ce6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 11068e33-76d1-4b27-80a7-41eadfef6a45] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:04:07.769337 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3ea19d13-ed6f-4de9-88bd-ba1516d51ce6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:07.769814 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3ea19d13-ed6f-4de9-88bd-ba1516d51ce6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:07.770249 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3ea19d13-ed6f-4de9-88bd-ba1516d51ce6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:07.770973 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3ea19d13-ed6f-4de9-88bd-ba1516d51ce6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:07.771418 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3ea19d13-ed6f-4de9-88bd-ba1516d51ce6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:07.771840 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-3ea19d13-ed6f-4de9-88bd-ba1516d51ce6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:07.898229 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-3ea19d13-ed6f-4de9-88bd-ba1516d51ce6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:04:07.906297 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-3ea19d13-ed6f-4de9-88bd-ba1516d51ce6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45" status: 200 len: 1267 microversion: 2.1 time: 0.147786 Aug 12 12:04:07.906896 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 557/1111] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:04:07 2022] GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:04:08.927020 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-8389f97a-2965-4f72-88ca-0ef15274afc1 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:04:08.927631 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-8389f97a-2965-4f72-88ca-0ef15274afc1 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 11068e33-76d1-4b27-80a7-41eadfef6a45] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:04:08.934415 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8389f97a-2965-4f72-88ca-0ef15274afc1 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:08.934950 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8389f97a-2965-4f72-88ca-0ef15274afc1 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:08.935381 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8389f97a-2965-4f72-88ca-0ef15274afc1 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:08.936057 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8389f97a-2965-4f72-88ca-0ef15274afc1 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:08.936503 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8389f97a-2965-4f72-88ca-0ef15274afc1 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:08.936920 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-8389f97a-2965-4f72-88ca-0ef15274afc1 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:09.067113 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-8389f97a-2965-4f72-88ca-0ef15274afc1 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:04:09.074519 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-8389f97a-2965-4f72-88ca-0ef15274afc1 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45" status: 200 len: 1267 microversion: 2.1 time: 0.151500 Aug 12 12:04:09.075104 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 555/1112] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:04:08 2022] GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:04:10.095705 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-96df2843-4f5a-4ef5-a542-5adab03c1d05 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:04:10.096312 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-96df2843-4f5a-4ef5-a542-5adab03c1d05 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 11068e33-76d1-4b27-80a7-41eadfef6a45] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:04:10.102757 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-96df2843-4f5a-4ef5-a542-5adab03c1d05 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:10.103236 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-96df2843-4f5a-4ef5-a542-5adab03c1d05 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:10.103669 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-96df2843-4f5a-4ef5-a542-5adab03c1d05 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:10.104355 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-96df2843-4f5a-4ef5-a542-5adab03c1d05 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:10.104807 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-96df2843-4f5a-4ef5-a542-5adab03c1d05 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:10.105229 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-96df2843-4f5a-4ef5-a542-5adab03c1d05 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:10.233567 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-96df2843-4f5a-4ef5-a542-5adab03c1d05 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:04:10.240901 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-96df2843-4f5a-4ef5-a542-5adab03c1d05 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45" status: 200 len: 1267 microversion: 2.1 time: 0.149066 Aug 12 12:04:10.241457 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 558/1113] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:04:10 2022] GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:04:11.261501 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d6f18867-a980-4e34-bb42-7897f8d6596f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:04:11.263028 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d6f18867-a980-4e34-bb42-7897f8d6596f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 11068e33-76d1-4b27-80a7-41eadfef6a45] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:04:11.269357 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d6f18867-a980-4e34-bb42-7897f8d6596f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:11.269842 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d6f18867-a980-4e34-bb42-7897f8d6596f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:11.270275 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d6f18867-a980-4e34-bb42-7897f8d6596f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:11.270982 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d6f18867-a980-4e34-bb42-7897f8d6596f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:11.271432 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d6f18867-a980-4e34-bb42-7897f8d6596f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:11.271854 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d6f18867-a980-4e34-bb42-7897f8d6596f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:11.402852 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d6f18867-a980-4e34-bb42-7897f8d6596f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:04:11.410894 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-d6f18867-a980-4e34-bb42-7897f8d6596f tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45" status: 200 len: 1267 microversion: 2.1 time: 0.153281 Aug 12 12:04:11.411496 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 556/1114] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:04:11 2022] GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:04:12.431795 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-018c8018-26ec-44f3-9ace-8392ef9734b5 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:04:12.432342 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-018c8018-26ec-44f3-9ace-8392ef9734b5 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 11068e33-76d1-4b27-80a7-41eadfef6a45] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:04:12.434865 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell0:SELECT=2 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:12.440156 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-018c8018-26ec-44f3-9ace-8392ef9734b5 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:12.440884 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-018c8018-26ec-44f3-9ace-8392ef9734b5 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:12.441310 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-018c8018-26ec-44f3-9ace-8392ef9734b5 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:12.441992 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-018c8018-26ec-44f3-9ace-8392ef9734b5 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:12.442434 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-018c8018-26ec-44f3-9ace-8392ef9734b5 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:12.442881 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-018c8018-26ec-44f3-9ace-8392ef9734b5 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:12.589743 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-018c8018-26ec-44f3-9ace-8392ef9734b5 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:04:12.597700 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-018c8018-26ec-44f3-9ace-8392ef9734b5 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45" status: 200 len: 1267 microversion: 2.1 time: 0.169779 Aug 12 12:04:12.598256 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 559/1115] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:04:12 2022] GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:04:13.618006 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-ac837933-622e-4051-b7a1-d7e8ff1136a4 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:04:13.618638 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-ac837933-622e-4051-b7a1-d7e8ff1136a4 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 11068e33-76d1-4b27-80a7-41eadfef6a45] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:04:13.620573 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=2 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:13.621384 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell0:SELECT=6 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:13.627685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ac837933-622e-4051-b7a1-d7e8ff1136a4 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:13.628165 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ac837933-622e-4051-b7a1-d7e8ff1136a4 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:13.628598 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ac837933-622e-4051-b7a1-d7e8ff1136a4 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:13.629286 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ac837933-622e-4051-b7a1-d7e8ff1136a4 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:13.629736 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ac837933-622e-4051-b7a1-d7e8ff1136a4 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:13.630165 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-ac837933-622e-4051-b7a1-d7e8ff1136a4 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:13.765983 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-ac837933-622e-4051-b7a1-d7e8ff1136a4 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:04:13.774975 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-ac837933-622e-4051-b7a1-d7e8ff1136a4 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45" status: 200 len: 1267 microversion: 2.1 time: 0.160875 Aug 12 12:04:13.776217 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 557/1116] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:04:13 2022] GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:04:14.796989 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-2c771f41-bebe-4341-8322-65c55d610412 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:04:14.797567 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-2c771f41-bebe-4341-8322-65c55d610412 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 11068e33-76d1-4b27-80a7-41eadfef6a45] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:04:14.803897 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2c771f41-bebe-4341-8322-65c55d610412 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:14.804378 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2c771f41-bebe-4341-8322-65c55d610412 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:14.804807 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2c771f41-bebe-4341-8322-65c55d610412 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:14.805495 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2c771f41-bebe-4341-8322-65c55d610412 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:14.805943 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2c771f41-bebe-4341-8322-65c55d610412 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:14.806361 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-2c771f41-bebe-4341-8322-65c55d610412 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:14.938940 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-2c771f41-bebe-4341-8322-65c55d610412 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:04:14.947392 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-2c771f41-bebe-4341-8322-65c55d610412 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45" status: 200 len: 1267 microversion: 2.1 time: 0.154662 Aug 12 12:04:14.948142 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 560/1117] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:04:14 2022] GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:04:15.969265 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-67e595e5-ca99-4b09-b2fa-9e9e5fac4fa0 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:04:15.969868 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-67e595e5-ca99-4b09-b2fa-9e9e5fac4fa0 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 11068e33-76d1-4b27-80a7-41eadfef6a45] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:04:15.976214 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-67e595e5-ca99-4b09-b2fa-9e9e5fac4fa0 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:15.976691 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-67e595e5-ca99-4b09-b2fa-9e9e5fac4fa0 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:15.977122 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-67e595e5-ca99-4b09-b2fa-9e9e5fac4fa0 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:15.977800 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-67e595e5-ca99-4b09-b2fa-9e9e5fac4fa0 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:15.978247 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-67e595e5-ca99-4b09-b2fa-9e9e5fac4fa0 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:15.978693 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-67e595e5-ca99-4b09-b2fa-9e9e5fac4fa0 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:16.111536 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-67e595e5-ca99-4b09-b2fa-9e9e5fac4fa0 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:04:16.118982 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-67e595e5-ca99-4b09-b2fa-9e9e5fac4fa0 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45" status: 200 len: 1267 microversion: 2.1 time: 0.154105 Aug 12 12:04:16.119549 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 558/1118] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:04:15 2022] GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:04:16.193614 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-b3e01549-bc36-405b-a1d2-871fab0f2222 req-2becd86d-c834-4f95-a051-ba62e7d0dc25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11068e33-76d1-4b27-80a7-41eadfef6a45", "name": "network-vif-plugged", "status": "completed", "tag": "20e8b515-5f76-4ea3-84e8-009a88a673dc"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:04:16.205512 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-b3e01549-bc36-405b-a1d2-871fab0f2222 req-2becd86d-c834-4f95-a051-ba62e7d0dc25 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:16.206877 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-b3e01549-bc36-405b-a1d2-871fab0f2222 req-2becd86d-c834-4f95-a051-ba62e7d0dc25 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:16.207311 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-b3e01549-bc36-405b-a1d2-871fab0f2222 req-2becd86d-c834-4f95-a051-ba62e7d0dc25 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:16.219091 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-b3e01549-bc36-405b-a1d2-871fab0f2222 req-2becd86d-c834-4f95-a051-ba62e7d0dc25 service nova] Creating event network-vif-plugged:20e8b515-5f76-4ea3-84e8-009a88a673dc for instance 11068e33-76d1-4b27-80a7-41eadfef6a45 on hv-cinder-85282 Aug 12 12:04:16.224055 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-b3e01549-bc36-405b-a1d2-871fab0f2222 req-2becd86d-c834-4f95-a051-ba62e7d0dc25 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034840 Aug 12 12:04:16.224635 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 561/1119] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 12:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:04:17.139525 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-a0b7519f-a3ec-4dd4-98f5-bd9a0212a3fd tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:04:17.140069 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-a0b7519f-a3ec-4dd4-98f5-bd9a0212a3fd tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 11068e33-76d1-4b27-80a7-41eadfef6a45] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:04:17.146454 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a0b7519f-a3ec-4dd4-98f5-bd9a0212a3fd tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:17.146978 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a0b7519f-a3ec-4dd4-98f5-bd9a0212a3fd tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:17.147446 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a0b7519f-a3ec-4dd4-98f5-bd9a0212a3fd tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:17.148141 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a0b7519f-a3ec-4dd4-98f5-bd9a0212a3fd tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:17.148596 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a0b7519f-a3ec-4dd4-98f5-bd9a0212a3fd tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:17.149026 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-a0b7519f-a3ec-4dd4-98f5-bd9a0212a3fd tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:17.279917 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-a0b7519f-a3ec-4dd4-98f5-bd9a0212a3fd tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:04:17.287127 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-a0b7519f-a3ec-4dd4-98f5-bd9a0212a3fd tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45" status: 200 len: 1267 microversion: 2.1 time: 0.151606 Aug 12 12:04:17.287679 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 559/1120] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:04:17 2022] GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:04:18.307909 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-195ea6f4-f2b4-4d59-a1e0-3889ea6f98ab tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:04:18.309199 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-195ea6f4-f2b4-4d59-a1e0-3889ea6f98ab tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 11068e33-76d1-4b27-80a7-41eadfef6a45] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:04:18.316002 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-195ea6f4-f2b4-4d59-a1e0-3889ea6f98ab tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:18.316480 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-195ea6f4-f2b4-4d59-a1e0-3889ea6f98ab tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:18.316908 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-195ea6f4-f2b4-4d59-a1e0-3889ea6f98ab tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:18.317591 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-195ea6f4-f2b4-4d59-a1e0-3889ea6f98ab tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:18.318038 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-195ea6f4-f2b4-4d59-a1e0-3889ea6f98ab tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:18.318462 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-195ea6f4-f2b4-4d59-a1e0-3889ea6f98ab tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:18.447663 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-195ea6f4-f2b4-4d59-a1e0-3889ea6f98ab tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:04:18.455164 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-195ea6f4-f2b4-4d59-a1e0-3889ea6f98ab tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45" status: 200 len: 1454 microversion: 2.1 time: 0.151435 Aug 12 12:04:18.455723 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 562/1121] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:04:18 2022] GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:04:18.474590 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-5d533e68-ea79-4b2e-a78b-43b4a632d338 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:04:18.475219 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-5d533e68-ea79-4b2e-a78b-43b4a632d338 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 11068e33-76d1-4b27-80a7-41eadfef6a45] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:04:18.481932 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5d533e68-ea79-4b2e-a78b-43b4a632d338 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:18.482405 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5d533e68-ea79-4b2e-a78b-43b4a632d338 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:18.482866 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5d533e68-ea79-4b2e-a78b-43b4a632d338 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:18.483548 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5d533e68-ea79-4b2e-a78b-43b4a632d338 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:18.483992 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5d533e68-ea79-4b2e-a78b-43b4a632d338 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:18.484409 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-5d533e68-ea79-4b2e-a78b-43b4a632d338 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:18.610948 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-5d533e68-ea79-4b2e-a78b-43b4a632d338 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:04:18.618413 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-5d533e68-ea79-4b2e-a78b-43b4a632d338 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45" status: 200 len: 1454 microversion: 2.1 time: 0.147554 Aug 12 12:04:18.619018 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 560/1122] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:04:18 2022] GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45 => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:04:20.434849 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-bcf0ad38-8a27-4d58-a3f0-308b76b2a04d req-63d49a12-47ce-4b78-9a91-f80241eae4cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11068e33-76d1-4b27-80a7-41eadfef6a45", "tag": "20e8b515-5f76-4ea3-84e8-009a88a673dc"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:04:20.444772 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-bcf0ad38-8a27-4d58-a3f0-308b76b2a04d req-63d49a12-47ce-4b78-9a91-f80241eae4cd service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:04:20.445250 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-bcf0ad38-8a27-4d58-a3f0-308b76b2a04d req-63d49a12-47ce-4b78-9a91-f80241eae4cd service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:04:20.445671 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-bcf0ad38-8a27-4d58-a3f0-308b76b2a04d req-63d49a12-47ce-4b78-9a91-f80241eae4cd service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:04:20.459448 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-bcf0ad38-8a27-4d58-a3f0-308b76b2a04d req-63d49a12-47ce-4b78-9a91-f80241eae4cd service nova] Creating event network-changed:20e8b515-5f76-4ea3-84e8-009a88a673dc for instance 11068e33-76d1-4b27-80a7-41eadfef6a45 on hv-cinder-85282 Aug 12 12:04:20.464377 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-bcf0ad38-8a27-4d58-a3f0-308b76b2a04d req-63d49a12-47ce-4b78-9a91-f80241eae4cd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033756 Aug 12 12:04:20.464963 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 563/1123] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 12:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:04:48.089804 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 12:04:48.090340 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Fri Aug 12 12:04:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 12:04:50.508752 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 12:04:50.509357 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Fri Aug 12 12:04:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 12:04:58.830625 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 12:04:58.831290 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Fri Aug 12 12:04:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 12:05:48.718405 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_api:SELECT=22 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:05:48.719219 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-632ee3c9-9b81-4f64-92f5-fd350c9a009e tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:05:48.719686 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG dbcounter [-] [132281] Writing DB stats nova_cell1:SELECT=46 {{(pid=132281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:05:48.720155 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-632ee3c9-9b81-4f64-92f5-fd350c9a009e tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 11068e33-76d1-4b27-80a7-41eadfef6a45] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:05:48.723315 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:05:48.724052 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG dbcounter [-] [132282] Writing DB stats nova_cell1:SELECT=52 {{(pid=132282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:05:48.724522 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-216afd6f-545a-481f-aa0b-554c43a8e04a req-2d859cbb-d3f6-4df7-a93b-696a41c73d19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11068e33-76d1-4b27-80a7-41eadfef6a45", "tag": "20e8b515-5f76-4ea3-84e8-009a88a673dc"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:05:48.731211 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-632ee3c9-9b81-4f64-92f5-fd350c9a009e tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:05:48.731783 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-632ee3c9-9b81-4f64-92f5-fd350c9a009e tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:05:48.732291 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-632ee3c9-9b81-4f64-92f5-fd350c9a009e tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:05:48.733071 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-632ee3c9-9b81-4f64-92f5-fd350c9a009e tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:05:48.733836 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-632ee3c9-9b81-4f64-92f5-fd350c9a009e tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:05:48.734813 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-632ee3c9-9b81-4f64-92f5-fd350c9a009e tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:05:48.735043 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-216afd6f-545a-481f-aa0b-554c43a8e04a req-2d859cbb-d3f6-4df7-a93b-696a41c73d19 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:05:48.735924 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-216afd6f-545a-481f-aa0b-554c43a8e04a req-2d859cbb-d3f6-4df7-a93b-696a41c73d19 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:05:48.736368 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-216afd6f-545a-481f-aa0b-554c43a8e04a req-2d859cbb-d3f6-4df7-a93b-696a41c73d19 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:05:48.749185 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-216afd6f-545a-481f-aa0b-554c43a8e04a req-2d859cbb-d3f6-4df7-a93b-696a41c73d19 service nova] Creating event network-changed:20e8b515-5f76-4ea3-84e8-009a88a673dc for instance 11068e33-76d1-4b27-80a7-41eadfef6a45 on hv-cinder-85282 Aug 12 12:05:48.754362 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-216afd6f-545a-481f-aa0b-554c43a8e04a req-2d859cbb-d3f6-4df7-a93b-696a41c73d19 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037791 Aug 12 12:05:48.755209 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 564/1124] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 12:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:05:48.767024 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-632ee3c9-9b81-4f64-92f5-fd350c9a009e tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 11068e33-76d1-4b27-80a7-41eadfef6a45] Going to try to terminate instance {{(pid=132282) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 12:05:48.867573 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-632ee3c9-9b81-4f64-92f5-fd350c9a009e tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "DELETE /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45" status: 204 len: 0 microversion: 2.1 time: 0.153332 Aug 12 12:05:48.872607 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 561/1125] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Aug 12 12:05:48 2022] DELETE /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 12:05:48.877906 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-510b6af5-4402-41c5-bcfe-68471529419a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:05:48.878594 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-510b6af5-4402-41c5-bcfe-68471529419a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 11068e33-76d1-4b27-80a7-41eadfef6a45] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:05:48.885432 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-510b6af5-4402-41c5-bcfe-68471529419a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:05:48.885906 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-510b6af5-4402-41c5-bcfe-68471529419a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:05:48.886331 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-510b6af5-4402-41c5-bcfe-68471529419a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:05:48.887264 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-510b6af5-4402-41c5-bcfe-68471529419a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:05:48.887919 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-510b6af5-4402-41c5-bcfe-68471529419a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:05:48.888335 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-510b6af5-4402-41c5-bcfe-68471529419a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:05:49.140038 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-510b6af5-4402-41c5-bcfe-68471529419a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:05:49.147773 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-510b6af5-4402-41c5-bcfe-68471529419a tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45" status: 200 len: 1578 microversion: 2.1 time: 0.274022 Aug 12 12:05:49.148332 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 565/1126] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:05:48 2022] GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45 => generated 1578 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:05:50.169780 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-d1a7fda0-7073-46a7-9def-f137227df0b0 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:05:50.170638 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-d1a7fda0-7073-46a7-9def-f137227df0b0 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 11068e33-76d1-4b27-80a7-41eadfef6a45] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:05:50.177654 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d1a7fda0-7073-46a7-9def-f137227df0b0 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:05:50.178143 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d1a7fda0-7073-46a7-9def-f137227df0b0 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:05:50.178577 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d1a7fda0-7073-46a7-9def-f137227df0b0 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:05:50.179300 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d1a7fda0-7073-46a7-9def-f137227df0b0 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:05:50.179756 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d1a7fda0-7073-46a7-9def-f137227df0b0 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:05:50.180183 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-d1a7fda0-7073-46a7-9def-f137227df0b0 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:05:50.364766 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-d1a7fda0-7073-46a7-9def-f137227df0b0 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:05:50.373204 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-d1a7fda0-7073-46a7-9def-f137227df0b0 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45" status: 200 len: 1578 microversion: 2.1 time: 0.207642 Aug 12 12:05:50.373759 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 562/1127] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:05:50 2022] GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45 => generated 1578 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:05:51.371398 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-3e6dc9cf-932d-45ae-989e-6556b90d3057 req-b94faea6-9854-45db-83fe-211b6651901d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11068e33-76d1-4b27-80a7-41eadfef6a45", "name": "network-vif-deleted", "tag": "20e8b515-5f76-4ea3-84e8-009a88a673dc"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:05:51.381332 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-3e6dc9cf-932d-45ae-989e-6556b90d3057 req-b94faea6-9854-45db-83fe-211b6651901d service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:05:51.381805 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-3e6dc9cf-932d-45ae-989e-6556b90d3057 req-b94faea6-9854-45db-83fe-211b6651901d service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:05:51.382231 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-3e6dc9cf-932d-45ae-989e-6556b90d3057 req-b94faea6-9854-45db-83fe-211b6651901d service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:05:51.393931 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-f55dcfa8-8664-4781-a4cf-fb991e08fea3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:05:51.394551 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-f55dcfa8-8664-4781-a4cf-fb991e08fea3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 11068e33-76d1-4b27-80a7-41eadfef6a45] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:05:51.399856 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-3e6dc9cf-932d-45ae-989e-6556b90d3057 req-b94faea6-9854-45db-83fe-211b6651901d service nova] Creating event network-vif-deleted:20e8b515-5f76-4ea3-84e8-009a88a673dc for instance 11068e33-76d1-4b27-80a7-41eadfef6a45 on hv-cinder-85282 Aug 12 12:05:51.401491 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f55dcfa8-8664-4781-a4cf-fb991e08fea3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:05:51.401970 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f55dcfa8-8664-4781-a4cf-fb991e08fea3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:05:51.402401 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f55dcfa8-8664-4781-a4cf-fb991e08fea3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:05:51.403176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f55dcfa8-8664-4781-a4cf-fb991e08fea3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:05:51.403614 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f55dcfa8-8664-4781-a4cf-fb991e08fea3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:05:51.404057 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-f55dcfa8-8664-4781-a4cf-fb991e08fea3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:05:51.405252 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-3e6dc9cf-932d-45ae-989e-6556b90d3057 req-b94faea6-9854-45db-83fe-211b6651901d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037359 Aug 12 12:05:51.406173 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 566/1128] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 12:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:05:51.475176 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-f55dcfa8-8664-4781-a4cf-fb991e08fea3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:05:51.482891 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-f55dcfa8-8664-4781-a4cf-fb991e08fea3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45" status: 200 len: 1226 microversion: 2.1 time: 0.092732 Aug 12 12:05:51.483372 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 563/1129] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:05:51 2022] GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:05:52.504756 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-732eeec5-c891-46a8-8a40-c74fe26ff8a6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:05:52.505404 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-732eeec5-c891-46a8-8a40-c74fe26ff8a6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 11068e33-76d1-4b27-80a7-41eadfef6a45] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:05:52.512240 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-732eeec5-c891-46a8-8a40-c74fe26ff8a6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:05:52.512718 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-732eeec5-c891-46a8-8a40-c74fe26ff8a6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:05:52.513153 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-732eeec5-c891-46a8-8a40-c74fe26ff8a6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:05:52.513834 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-732eeec5-c891-46a8-8a40-c74fe26ff8a6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:05:52.514281 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-732eeec5-c891-46a8-8a40-c74fe26ff8a6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:05:52.514734 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-732eeec5-c891-46a8-8a40-c74fe26ff8a6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:05:52.528117 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.wsgi [None req-732eeec5-c891-46a8-8a40-c74fe26ff8a6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] HTTP exception thrown: Instance 11068e33-76d1-4b27-80a7-41eadfef6a45 could not be found. Aug 12 12:05:52.529727 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-732eeec5-c891-46a8-8a40-c74fe26ff8a6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Request method failure captured: Aug 12 12:05:52.529727 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45 HTTP/1.1 Aug 12 12:05:52.529727 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 12:05:52.529727 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 12:05:52.529727 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 12:05:52.529727 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 0 Aug 12 12:05:52.529727 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 12:05:52.529727 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 12:05:52.529727 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 12:05:52.529727 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 12:05:52.529727 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9kCanZ2V3Hc8cbSf84Jj7mUX8xXh6hOIJFbhQgyOcYxiWBVkHcH-Yjf1_gAEi1-i-BvXnlv354cGQLkK6yxbOCjBNznt0iFvL2uiVERCq4ckSRTn0F5aKpSoenkZR3VgjbiDim6lc8w3-IdWaccR9UKmoEBvC3jma7ZwwVH5pcNCX4o Aug 12 12:05:52.529727 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 12:05:52.529727 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 12:05:52.529727 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 12:05:52.529727 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 12:05:52.529727 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 12:05:52.529727 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 12:05:52.529727 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: 45a982b3e219420fb17c07b591042992 Aug 12 12:05:52.529727 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-TestVolumeBootPattern-1893673039 Aug 12 12:05:52.529727 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 12:05:52.529727 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 12:05:52.531636 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_45a982b3e219420fb17c07b591042992", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/45a982b3e219420fb17c07b591042992"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/45a982b3e219420fb17c07b591042992"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/45a982b3e219420fb17c07b591042992"}]}] Aug 12 12:05:52.531636 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-TestVolumeBootPattern-1893673039 Aug 12 12:05:52.531636 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: 45a982b3e219420fb17c07b591042992 Aug 12 12:05:52.531636 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-TestVolumeBootPattern-1893673039 Aug 12 12:05:52.531636 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-TestVolumeBootPattern-1893673039-project Aug 12 12:05:52.531636 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 12:05:52.531636 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 12:05:52.531636 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: bd3289f4fa7745ceb12f4d5cd7f901c6 Aug 12 12:05:52.531636 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-TestVolumeBootPattern-1893673039-project Aug 12 12:05:52.531636 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: > Aug 12 12:05:52.531636 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Instance 11068e33-76d1-4b27-80a7-41eadfef6a45 could not be found. Aug 12 12:05:52.531636 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'id': '11068e33-76d1-4b27-80a7-41eadfef6a45'} Aug 12 12:05:52.532815 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:05:52.532815 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:05:52.532815 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:05:52.532815 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:05:52.532815 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:05:52.532815 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:05:52.532815 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:05:52.532815 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:05:52.532815 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:05:52.532815 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:05:52.532815 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11068e33-76d1-4b27-80a7-41eadfef6a45 could not be found. Aug 12 12:05:52.532815 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 12:05:52.532815 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:05:52.532815 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 12:05:52.532815 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:05:52.532815 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:05:52.532815 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:05:52.532815 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:05:52.532815 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:05:52.532815 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:05:52.534642 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:05:52.534642 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:05:52.534642 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:05:52.534642 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:05:52.534642 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:05:52.534642 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:05:52.534642 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:05:52.534642 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11068e33-76d1-4b27-80a7-41eadfef6a45 could not be found. Aug 12 12:05:52.534642 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 12:05:52.534642 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:05:52.534642 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 12:05:52.534642 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:05:52.534642 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:05:52.534642 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:05:52.534642 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:05:52.534642 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:05:52.534642 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11068e33-76d1-4b27-80a7-41eadfef6a45 could not be found. Aug 12 12:05:52.534642 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 12:05:52.536167 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-732eeec5-c891-46a8-8a40-c74fe26ff8a6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Returning 404 to user: Instance 11068e33-76d1-4b27-80a7-41eadfef6a45 could not be found. {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:05:52.536167 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-732eeec5-c891-46a8-8a40-c74fe26ff8a6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45" status: 404 len: 111 microversion: 2.1 time: 0.031193 Aug 12 12:05:52.536167 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 567/1130] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:05:52 2022] GET /compute/v2.1/servers/11068e33-76d1-4b27-80a7-41eadfef6a45 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:05:55.858493 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-f2979df2-7a35-407c-8b02-88c68b4b09b6 req-fb3d406c-5150-4b54-baf1-1924ca83623e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "401b05d6-33dc-4696-926c-0bb13eff3a17", "tag": "d4449365-be8a-41c1-88d7-21ddec20bd52"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:05:55.861043 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-b9e9d47a-2d24-4fdd-913d-0c14a96b8080 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:05:55.862088 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-b9e9d47a-2d24-4fdd-913d-0c14a96b8080 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 401b05d6-33dc-4696-926c-0bb13eff3a17] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:05:55.868402 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b9e9d47a-2d24-4fdd-913d-0c14a96b8080 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:05:55.868600 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-f2979df2-7a35-407c-8b02-88c68b4b09b6 req-fb3d406c-5150-4b54-baf1-1924ca83623e service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:05:55.868893 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b9e9d47a-2d24-4fdd-913d-0c14a96b8080 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:05:55.869018 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-f2979df2-7a35-407c-8b02-88c68b4b09b6 req-fb3d406c-5150-4b54-baf1-1924ca83623e service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:05:55.869331 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b9e9d47a-2d24-4fdd-913d-0c14a96b8080 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:05:55.869450 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-f2979df2-7a35-407c-8b02-88c68b4b09b6 req-fb3d406c-5150-4b54-baf1-1924ca83623e service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:05:55.874302 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b9e9d47a-2d24-4fdd-913d-0c14a96b8080 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:05:55.874816 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b9e9d47a-2d24-4fdd-913d-0c14a96b8080 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:05:55.875394 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-b9e9d47a-2d24-4fdd-913d-0c14a96b8080 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:05:55.883896 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-f2979df2-7a35-407c-8b02-88c68b4b09b6 req-fb3d406c-5150-4b54-baf1-1924ca83623e service nova] Creating event network-changed:d4449365-be8a-41c1-88d7-21ddec20bd52 for instance 401b05d6-33dc-4696-926c-0bb13eff3a17 on hv-cinder-85282 Aug 12 12:05:55.889952 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-f2979df2-7a35-407c-8b02-88c68b4b09b6 req-fb3d406c-5150-4b54-baf1-1924ca83623e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035018 Aug 12 12:05:55.890869 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 568/1131] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 12:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:05:55.902709 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-b9e9d47a-2d24-4fdd-913d-0c14a96b8080 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 401b05d6-33dc-4696-926c-0bb13eff3a17] Going to try to terminate instance {{(pid=132282) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 12:05:55.987531 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-b9e9d47a-2d24-4fdd-913d-0c14a96b8080 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "DELETE /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17" status: 204 len: 0 microversion: 2.1 time: 0.134769 Aug 12 12:05:55.988274 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 564/1132] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Aug 12 12:05:55 2022] DELETE /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 12 12:05:55.998700 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-47ed7cfd-e5ac-4a47-86d9-e64bbe2be7e3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:05:55.999626 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-47ed7cfd-e5ac-4a47-86d9-e64bbe2be7e3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 401b05d6-33dc-4696-926c-0bb13eff3a17] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:05:56.006277 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-47ed7cfd-e5ac-4a47-86d9-e64bbe2be7e3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:05:56.007252 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-47ed7cfd-e5ac-4a47-86d9-e64bbe2be7e3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:05:56.007841 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-47ed7cfd-e5ac-4a47-86d9-e64bbe2be7e3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:05:56.008837 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-47ed7cfd-e5ac-4a47-86d9-e64bbe2be7e3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:05:56.009441 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-47ed7cfd-e5ac-4a47-86d9-e64bbe2be7e3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:05:56.010022 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-47ed7cfd-e5ac-4a47-86d9-e64bbe2be7e3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:05:56.177374 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.policy [None req-47ed7cfd-e5ac-4a47-86d9-e64bbe2be7e3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132281) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:05:56.185115 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-47ed7cfd-e5ac-4a47-86d9-e64bbe2be7e3 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17" status: 200 len: 1580 microversion: 2.1 time: 0.192220 Aug 12 12:05:56.185683 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 569/1133] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:05:55 2022] GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17 => generated 1580 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:05:57.207185 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-c24cef80-c86e-488a-86de-414e7ff4d5f6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:05:57.207812 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-c24cef80-c86e-488a-86de-414e7ff4d5f6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 401b05d6-33dc-4696-926c-0bb13eff3a17] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:05:57.214800 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c24cef80-c86e-488a-86de-414e7ff4d5f6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:05:57.215289 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c24cef80-c86e-488a-86de-414e7ff4d5f6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:05:57.215731 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c24cef80-c86e-488a-86de-414e7ff4d5f6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:05:57.216425 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c24cef80-c86e-488a-86de-414e7ff4d5f6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:05:57.216882 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c24cef80-c86e-488a-86de-414e7ff4d5f6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:05:57.217308 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-c24cef80-c86e-488a-86de-414e7ff4d5f6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:05:57.418334 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-c24cef80-c86e-488a-86de-414e7ff4d5f6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:05:57.425837 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-c24cef80-c86e-488a-86de-414e7ff4d5f6 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17" status: 200 len: 1580 microversion: 2.1 time: 0.223055 Aug 12 12:05:57.426405 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 565/1134] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:05:57 2022] GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17 => generated 1580 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:05:58.428069 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [req-f3d20148-58c4-4d50-81f0-b6b9f9e0551c req-b9be90c9-62e1-45eb-99cb-4dd748103633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "401b05d6-33dc-4696-926c-0bb13eff3a17", "name": "network-vif-deleted", "tag": "d4449365-be8a-41c1-88d7-21ddec20bd52"}]} {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:05:58.438205 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-f3d20148-58c4-4d50-81f0-b6b9f9e0551c req-b9be90c9-62e1-45eb-99cb-4dd748103633 service nova] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:05:58.438706 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-f3d20148-58c4-4d50-81f0-b6b9f9e0551c req-b9be90c9-62e1-45eb-99cb-4dd748103633 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:05:58.439165 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [req-f3d20148-58c4-4d50-81f0-b6b9f9e0551c req-b9be90c9-62e1-45eb-99cb-4dd748103633 service nova] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:05:58.449685 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-11776f25-9cc9-4674-a174-774fbde1ed4b tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:05:58.450631 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-11776f25-9cc9-4674-a174-774fbde1ed4b tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 401b05d6-33dc-4696-926c-0bb13eff3a17] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:05:58.451265 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.compute.server_external_events [req-f3d20148-58c4-4d50-81f0-b6b9f9e0551c req-b9be90c9-62e1-45eb-99cb-4dd748103633 service nova] Creating event network-vif-deleted:d4449365-be8a-41c1-88d7-21ddec20bd52 for instance 401b05d6-33dc-4696-926c-0bb13eff3a17 on hv-cinder-85282 Aug 12 12:05:58.456047 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [req-f3d20148-58c4-4d50-81f0-b6b9f9e0551c req-b9be90c9-62e1-45eb-99cb-4dd748103633 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031571 Aug 12 12:05:58.456833 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 570/1135] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Aug 12 12:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:05:58.457955 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-11776f25-9cc9-4674-a174-774fbde1ed4b tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:05:58.458455 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-11776f25-9cc9-4674-a174-774fbde1ed4b tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:05:58.459199 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-11776f25-9cc9-4674-a174-774fbde1ed4b tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:05:58.459864 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-11776f25-9cc9-4674-a174-774fbde1ed4b tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:05:58.460413 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-11776f25-9cc9-4674-a174-774fbde1ed4b tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:05:58.460863 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-11776f25-9cc9-4674-a174-774fbde1ed4b tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:05:58.527451 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.policy [None req-11776f25-9cc9-4674-a174-774fbde1ed4b tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3289f4fa7745ceb12f4d5cd7f901c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a982b3e219420fb17c07b591042992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132282) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:05:58.534984 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-11776f25-9cc9-4674-a174-774fbde1ed4b tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17" status: 200 len: 1226 microversion: 2.1 time: 0.091225 Aug 12 12:05:58.535541 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 566/1136] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:05:58 2022] GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:05:59.558256 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-39872651-1e89-428e-95ed-07dd48a45c19 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:05:59.558978 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-39872651-1e89-428e-95ed-07dd48a45c19 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 401b05d6-33dc-4696-926c-0bb13eff3a17] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:05:59.565110 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-39872651-1e89-428e-95ed-07dd48a45c19 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:05:59.565585 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-39872651-1e89-428e-95ed-07dd48a45c19 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:05:59.566286 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-39872651-1e89-428e-95ed-07dd48a45c19 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:05:59.566976 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-39872651-1e89-428e-95ed-07dd48a45c19 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:05:59.567426 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-39872651-1e89-428e-95ed-07dd48a45c19 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:05:59.567846 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-39872651-1e89-428e-95ed-07dd48a45c19 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:05:59.580695 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.wsgi [None req-39872651-1e89-428e-95ed-07dd48a45c19 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] HTTP exception thrown: Instance 401b05d6-33dc-4696-926c-0bb13eff3a17 could not be found. Aug 12 12:05:59.582278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-39872651-1e89-428e-95ed-07dd48a45c19 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Request method failure captured: Aug 12 12:05:59.582278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17 HTTP/1.1 Aug 12 12:05:59.582278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 12:05:59.582278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 12:05:59.582278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 12:05:59.582278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 0 Aug 12 12:05:59.582278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 12:05:59.582278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 12:05:59.582278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 12:05:59.582278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 12:05:59.582278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9kCanZ2V3Hc8cbSf84Jj7mUX8xXh6hOIJFbhQgyOcYxiWBVkHcH-Yjf1_gAEi1-i-BvXnlv354cGQLkK6yxbOCjBNznt0iFvL2uiVERCq4ckSRTn0F5aKpSoenkZR3VgjbiDim6lc8w3-IdWaccR9UKmoEBvC3jma7ZwwVH5pcNCX4o Aug 12 12:05:59.582278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 12:05:59.582278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 12:05:59.582278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 12:05:59.582278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 12:05:59.582278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 12:05:59.582278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 12:05:59.582278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: 45a982b3e219420fb17c07b591042992 Aug 12 12:05:59.582278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-TestVolumeBootPattern-1893673039 Aug 12 12:05:59.582278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 12:05:59.582278 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 12:05:59.584045 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_45a982b3e219420fb17c07b591042992", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/45a982b3e219420fb17c07b591042992"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/45a982b3e219420fb17c07b591042992"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/45a982b3e219420fb17c07b591042992"}]}] Aug 12 12:05:59.584045 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-TestVolumeBootPattern-1893673039 Aug 12 12:05:59.584045 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: 45a982b3e219420fb17c07b591042992 Aug 12 12:05:59.584045 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-TestVolumeBootPattern-1893673039 Aug 12 12:05:59.584045 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-TestVolumeBootPattern-1893673039-project Aug 12 12:05:59.584045 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 12:05:59.584045 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 12:05:59.584045 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: bd3289f4fa7745ceb12f4d5cd7f901c6 Aug 12 12:05:59.584045 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-TestVolumeBootPattern-1893673039-project Aug 12 12:05:59.584045 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: > Aug 12 12:05:59.584045 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Instance 401b05d6-33dc-4696-926c-0bb13eff3a17 could not be found. Aug 12 12:05:59.584045 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'id': '401b05d6-33dc-4696-926c-0bb13eff3a17'} Aug 12 12:05:59.585024 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:05:59.585024 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:05:59.585024 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:05:59.585024 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:05:59.585024 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:05:59.585024 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:05:59.585024 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:05:59.585024 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:05:59.585024 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:05:59.585024 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:05:59.585024 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 401b05d6-33dc-4696-926c-0bb13eff3a17 could not be found. Aug 12 12:05:59.585024 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 12:05:59.585024 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:05:59.585024 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 12:05:59.585024 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:05:59.585024 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:05:59.585024 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:05:59.585024 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:05:59.585024 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:05:59.585024 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:05:59.586634 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:05:59.586634 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:05:59.586634 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:05:59.586634 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:05:59.586634 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:05:59.586634 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:05:59.586634 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:05:59.586634 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 401b05d6-33dc-4696-926c-0bb13eff3a17 could not be found. Aug 12 12:05:59.586634 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 12:05:59.586634 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:05:59.586634 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 12:05:59.586634 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:05:59.586634 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:05:59.586634 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:05:59.586634 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:05:59.586634 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:05:59.586634 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 401b05d6-33dc-4696-926c-0bb13eff3a17 could not be found. Aug 12 12:05:59.586634 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 12:05:59.588167 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-39872651-1e89-428e-95ed-07dd48a45c19 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Returning 404 to user: Instance 401b05d6-33dc-4696-926c-0bb13eff3a17 could not be found. {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:05:59.588167 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-39872651-1e89-428e-95ed-07dd48a45c19 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17" status: 404 len: 111 microversion: 2.1 time: 0.030822 Aug 12 12:05:59.588167 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 571/1137] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:05:59 2022] GET /compute/v2.1/servers/401b05d6-33dc-4696-926c-0bb13eff3a17 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:06:00.025740 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-68efff41-a617-487e-b117-7df3e52417eb tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:06:00.026258 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.compute.api [None req-68efff41-a617-487e-b117-7df3e52417eb tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 360f8059-fa58-4972-a431-b0822d419e4e] Fetching instance by UUID {{(pid=132282) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:06:00.033652 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-68efff41-a617-487e-b117-7df3e52417eb tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:06:00.034132 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-68efff41-a617-487e-b117-7df3e52417eb tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:06:00.034564 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-68efff41-a617-487e-b117-7df3e52417eb tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:06:00.035277 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-68efff41-a617-487e-b117-7df3e52417eb tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:06:00.035728 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-68efff41-a617-487e-b117-7df3e52417eb tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:06:00.036144 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG oslo_concurrency.lockutils [None req-68efff41-a617-487e-b117-7df3e52417eb tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:06:00.051612 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.wsgi [None req-68efff41-a617-487e-b117-7df3e52417eb tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] HTTP exception thrown: Instance 360f8059-fa58-4972-a431-b0822d419e4e could not be found. Aug 12 12:06:00.053230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-68efff41-a617-487e-b117-7df3e52417eb tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Request method failure captured: Aug 12 12:06:00.053230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: request: DELETE /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e HTTP/1.1 Aug 12 12:06:00.053230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept: application/json Aug 12 12:06:00.053230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Accept-Encoding: identity Aug 12 12:06:00.053230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Connection: close Aug 12 12:06:00.053230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Length: 0 Aug 12 12:06:00.053230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Content-Type: application/json Aug 12 12:06:00.053230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Host: 10.222.0.42 Aug 12 12:06:00.053230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Openstack-System-Scope: None Aug 12 12:06:00.053230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: User-Agent: python-urllib3/1.26.11 Aug 12 12:06:00.053230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Auth-Token: gAAAAABi9kCanZ2V3Hc8cbSf84Jj7mUX8xXh6hOIJFbhQgyOcYxiWBVkHcH-Yjf1_gAEi1-i-BvXnlv354cGQLkK6yxbOCjBNznt0iFvL2uiVERCq4ckSRTn0F5aKpSoenkZR3VgjbiDim6lc8w3-IdWaccR9UKmoEBvC3jma7ZwwVH5pcNCX4o Aug 12 12:06:00.053230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Id: None Aug 12 12:06:00.053230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Domain-Name: None Aug 12 12:06:00.053230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Identity-Status: Confirmed Aug 12 12:06:00.053230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Is-Admin-Project: True Aug 12 12:06:00.053230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Id: default Aug 12 12:06:00.053230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Domain-Name: Default Aug 12 12:06:00.053230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Id: 45a982b3e219420fb17c07b591042992 Aug 12 12:06:00.053230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Project-Name: tempest-TestVolumeBootPattern-1893673039 Aug 12 12:06:00.053230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Role: reader,member Aug 12 12:06:00.053230 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Roles: reader,member Aug 12 12:06:00.055443 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_45a982b3e219420fb17c07b591042992", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/45a982b3e219420fb17c07b591042992"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/45a982b3e219420fb17c07b591042992"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/45a982b3e219420fb17c07b591042992"}]}] Aug 12 12:06:00.055443 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant: tempest-TestVolumeBootPattern-1893673039 Aug 12 12:06:00.055443 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Id: 45a982b3e219420fb17c07b591042992 Aug 12 12:06:00.055443 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-Tenant-Name: tempest-TestVolumeBootPattern-1893673039 Aug 12 12:06:00.055443 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User: tempest-TestVolumeBootPattern-1893673039-project Aug 12 12:06:00.055443 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Id: default Aug 12 12:06:00.055443 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Domain-Name: Default Aug 12 12:06:00.055443 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Id: bd3289f4fa7745ceb12f4d5cd7f901c6 Aug 12 12:06:00.055443 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: X-User-Name: tempest-TestVolumeBootPattern-1893673039-project Aug 12 12:06:00.055443 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: method: > Aug 12 12:06:00.055443 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: exception: Instance 360f8059-fa58-4972-a431-b0822d419e4e could not be found. Aug 12 12:06:00.055443 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: action_args: {'id': '360f8059-fa58-4972-a431-b0822d419e4e'} Aug 12 12:06:00.056498 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:06:00.056498 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:06:00.056498 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:06:00.056498 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:06:00.056498 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:06:00.056498 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:06:00.056498 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:06:00.056498 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:06:00.056498 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:06:00.056498 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:06:00.056498 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 360f8059-fa58-4972-a431-b0822d419e4e could not be found. Aug 12 12:06:00.056498 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 12:06:00.056498 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:06:00.056498 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 12:06:00.056498 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:06:00.056498 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:06:00.056498 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:06:00.056498 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:06:00.056498 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:06:00.056498 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:06:00.058137 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:06:00.058137 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 12:06:00.058137 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 12:06:00.058137 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 12:06:00.058137 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 12:06:00.058137 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:06:00.058137 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:06:00.058137 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:06:00.058137 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:06:00.058137 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 360f8059-fa58-4972-a431-b0822d419e4e could not be found. Aug 12 12:06:00.058137 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 12:06:00.058137 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:06:00.058137 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 12:06:00.058137 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:06:00.058137 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:06:00.058137 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:06:00.058137 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:06:00.058137 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:06:00.058137 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 360f8059-fa58-4972-a431-b0822d419e4e could not be found. Aug 12 12:06:00.058137 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: ERROR nova.api.openstack.wsgi Aug 12 12:06:00.059797 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-68efff41-a617-487e-b117-7df3e52417eb tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Returning 404 to user: Instance 360f8059-fa58-4972-a431-b0822d419e4e could not be found. {{(pid=132282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:06:00.059797 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-68efff41-a617-487e-b117-7df3e52417eb tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "DELETE /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e" status: 404 len: 111 microversion: 2.1 time: 0.032773 Aug 12 12:06:00.059797 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 567/1138] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Aug 12 12:06:00 2022] DELETE /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:06:00.063611 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-9ffe3498-018c-4187-86e6-a9fc492b17f7 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '>' {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:06:00.064210 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.compute.api [None req-9ffe3498-018c-4187-86e6-a9fc492b17f7 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] [instance: 360f8059-fa58-4972-a431-b0822d419e4e] Fetching instance by UUID {{(pid=132281) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:06:00.070336 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9ffe3498-018c-4187-86e6-a9fc492b17f7 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:06:00.071405 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9ffe3498-018c-4187-86e6-a9fc492b17f7 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:06:00.071830 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9ffe3498-018c-4187-86e6-a9fc492b17f7 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:06:00.072504 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9ffe3498-018c-4187-86e6-a9fc492b17f7 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Acquiring lock "b9c220d7-2838-4982-b405-2795c460dd82" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:06:00.072949 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9ffe3498-018c-4187-86e6-a9fc492b17f7 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:06:00.073363 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG oslo_concurrency.lockutils [None req-9ffe3498-018c-4187-86e6-a9fc492b17f7 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Lock "b9c220d7-2838-4982-b405-2795c460dd82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:06:00.086826 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.wsgi [None req-9ffe3498-018c-4187-86e6-a9fc492b17f7 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] HTTP exception thrown: Instance 360f8059-fa58-4972-a431-b0822d419e4e could not be found. Aug 12 12:06:00.088315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-9ffe3498-018c-4187-86e6-a9fc492b17f7 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Request method failure captured: Aug 12 12:06:00.088315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: request: GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e HTTP/1.1 Aug 12 12:06:00.088315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept: application/json Aug 12 12:06:00.088315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Accept-Encoding: identity Aug 12 12:06:00.088315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Connection: close Aug 12 12:06:00.088315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Length: 0 Aug 12 12:06:00.088315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Content-Type: application/json Aug 12 12:06:00.088315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Host: 10.222.0.42 Aug 12 12:06:00.088315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Openstack-System-Scope: None Aug 12 12:06:00.088315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: User-Agent: python-urllib3/1.26.11 Aug 12 12:06:00.088315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Auth-Token: gAAAAABi9kCanZ2V3Hc8cbSf84Jj7mUX8xXh6hOIJFbhQgyOcYxiWBVkHcH-Yjf1_gAEi1-i-BvXnlv354cGQLkK6yxbOCjBNznt0iFvL2uiVERCq4ckSRTn0F5aKpSoenkZR3VgjbiDim6lc8w3-IdWaccR9UKmoEBvC3jma7ZwwVH5pcNCX4o Aug 12 12:06:00.088315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Id: None Aug 12 12:06:00.088315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Domain-Name: None Aug 12 12:06:00.088315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Identity-Status: Confirmed Aug 12 12:06:00.088315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Is-Admin-Project: True Aug 12 12:06:00.088315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Id: default Aug 12 12:06:00.088315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Domain-Name: Default Aug 12 12:06:00.088315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Id: 45a982b3e219420fb17c07b591042992 Aug 12 12:06:00.088315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Project-Name: tempest-TestVolumeBootPattern-1893673039 Aug 12 12:06:00.088315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Role: reader,member Aug 12 12:06:00.088315 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Roles: reader,member Aug 12 12:06:00.090096 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_45a982b3e219420fb17c07b591042992", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/45a982b3e219420fb17c07b591042992"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/45a982b3e219420fb17c07b591042992"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/45a982b3e219420fb17c07b591042992"}]}] Aug 12 12:06:00.090096 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant: tempest-TestVolumeBootPattern-1893673039 Aug 12 12:06:00.090096 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Id: 45a982b3e219420fb17c07b591042992 Aug 12 12:06:00.090096 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-Tenant-Name: tempest-TestVolumeBootPattern-1893673039 Aug 12 12:06:00.090096 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User: tempest-TestVolumeBootPattern-1893673039-project Aug 12 12:06:00.090096 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Id: default Aug 12 12:06:00.090096 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Domain-Name: Default Aug 12 12:06:00.090096 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Id: bd3289f4fa7745ceb12f4d5cd7f901c6 Aug 12 12:06:00.090096 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: X-User-Name: tempest-TestVolumeBootPattern-1893673039-project Aug 12 12:06:00.090096 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: method: > Aug 12 12:06:00.090096 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: exception: Instance 360f8059-fa58-4972-a431-b0822d419e4e could not be found. Aug 12 12:06:00.090096 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: action_args: {'id': '360f8059-fa58-4972-a431-b0822d419e4e'} Aug 12 12:06:00.094036 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: {{(pid=132281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:06:00.094036 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:06:00.094036 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:06:00.094036 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:06:00.094036 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:06:00.094036 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:06:00.094036 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:06:00.094036 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:06:00.094036 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:06:00.094036 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:06:00.094036 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 360f8059-fa58-4972-a431-b0822d419e4e could not be found. Aug 12 12:06:00.094036 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 12:06:00.094036 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:06:00.094036 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 12:06:00.094036 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:06:00.094036 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:06:00.094036 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:06:00.094036 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:06:00.094036 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:06:00.094036 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:06:00.095441 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:06:00.095441 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:06:00.095441 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:06:00.095441 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:06:00.095441 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:06:00.095441 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:06:00.095441 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:06:00.095441 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 360f8059-fa58-4972-a431-b0822d419e4e could not be found. Aug 12 12:06:00.095441 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 12:06:00.095441 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:06:00.095441 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 12:06:00.095441 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:06:00.095441 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:06:00.095441 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:06:00.095441 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:06:00.095441 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:06:00.095441 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 360f8059-fa58-4972-a431-b0822d419e4e could not be found. Aug 12 12:06:00.095441 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: ERROR nova.api.openstack.wsgi Aug 12 12:06:00.097132 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: DEBUG nova.api.openstack.wsgi [None req-9ffe3498-018c-4187-86e6-a9fc492b17f7 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Returning 404 to user: Instance 360f8059-fa58-4972-a431-b0822d419e4e could not be found. {{(pid=132281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:06:00.097132 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO nova.api.openstack.requestlog [None req-9ffe3498-018c-4187-86e6-a9fc492b17f7 tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e" status: 404 len: 111 microversion: 2.1 time: 0.029870 Aug 12 12:06:00.097132 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: [pid: 132281|app: 0|req: 572/1139] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Aug 12 12:06:00 2022] GET /compute/v2.1/servers/360f8059-fa58-4972-a431-b0822d419e4e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:06:01.376867 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: DEBUG nova.api.openstack.wsgi [None req-1cdf7b85-7097-4229-9afd-13473e47b59c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] Calling method '.version_select at 0x7f3e583da1f0>' {{(pid=132282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:06:01.398540 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO nova.api.openstack.requestlog [None req-1cdf7b85-7097-4229-9afd-13473e47b59c tempest-TestVolumeBootPattern-1893673039 tempest-TestVolumeBootPattern-1893673039-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1684938935" status: 202 len: 0 microversion: 2.1 time: 0.025439 Aug 12 12:06:01.402998 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: [pid: 132282|app: 0|req: 568/1140] 10.222.0.42 () {58 vars in 1263 bytes} [Fri Aug 12 12:06:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1684938935 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:08:10.516589 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 12:08:10.517211 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Fri Aug 12 12:08:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 12:08:18.838879 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 12:08:18.839456 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Fri Aug 12 12:08:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 12:08:36.748508 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 12:08:36.749127 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Fri Aug 12 12:08:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 12:08:39.650714 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 12:08:39.651247 dv-cinder-852828-2-iscsi devstack@n-api.service[132281]: Fri Aug 12 12:08:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 12:09:58.542567 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 12:09:58.543252 dv-cinder-852828-2-iscsi devstack@n-api.service[132282]: Fri Aug 12 12:09:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!